From b3791ba0971bd629860f25138e9c286602e2bb48 Mon Sep 17 00:00:00 2001 From: Christopher Boustros <46546409+christopher-boustros@users.noreply.github.com> Date: Sun, 29 Aug 2021 17:53:52 -0400 Subject: [PATCH] Add README --- README.md | 149 +++++++++++++++++++++++++++++++++++++++++ experiment_results.png | Bin 0 -> 23914 bytes 2 files changed, 149 insertions(+) create mode 100644 README.md create mode 100644 experiment_results.png diff --git a/README.md b/README.md new file mode 100644 index 0000000..d13b14c --- /dev/null +++ b/README.md @@ -0,0 +1,149 @@ +# Java Multithreaded Virtual Terrain Generator +![GitHub code size](https://img.shields.io/github/languages/code-size/christopher-boustros/Java-Multithreaded-Virtual-Terrain-Generator "Code size") +![GitHub license](https://img.shields.io/github/license/christopher-boustros/Java-Multithreaded-Virtual-Terrain-Generator "License") + +## Overview + +A Java multithreaded program that uses line segments to generate an image of a random 2D virtual terrain. The program generates these terrains as *heightmaps*, where each pixel of the image has a brightness that corresponds to a height value. This program was made as part of a course assignment for COMP 409 Concurrent Programming in winter 2021 at McGill University. + +In the context of this project, the term *fault line* will be used to describe a line segment that intersects two different edges of a rectangle. That rectangle is the shape of the terrain image that the program will generate. To randomize the height values assigned to each pixel of the rectangular terrain image, a random fault line is chosen on the image and the height values of all the pixels to the left or right of the line are all increased by a random integer value. By repeating this process with multiple fault lines, the height values of each pixel gradually become more distinct. Once finished, the program generates the image by assigning a grayscale color to each pixel such that the higher the height value of the pixel, the brighter the pixel will be. + +
+ +This is a sample image of a terrain generated by the program. The image has pixel resolution 720x576 and was generated using 5,000 fault lines. + +![Alt text](/samples/terrain_720x576_5000_fault_lines.png?raw=true "Sample terrain") + +
+ +The following are six sample terrain images generated by the program with an increasing number of fault lines. Each image has pixel resolution 176x144. As the number of fault lines increases, it becomes more difficult to see the individual fault lines and the terrain appears to be smoother and more detailed. + +![Alt text](/samples/six_samples.png?raw=true "Six sample terrains") + +

+ +## Purpose of Heightmaps + +As explained above, the rectangular terrain image generated by the program is a heightmap, where each pixel of the image has a brightness that corresponds to a height value. The brighter the pixel, the higher the height value associated with it. A 2D heightmap can be used to render a 3D terrain since each pixel on the map has three components: the horizontal and vertical (x, y) coordinates of the pixel and its height value; thus, each pixel can be mapped to a point in 3D space in order to render a 3D terrain. + +The ability to randomly generate a 2D heightmap is useful for video games as it allows complex and detailed 3D terrain to be generated *procedurally*. *Procedural generation* is a process in which content is generated by a computer rather than being created manually. Heightmaps are an efficient method of procedural terrain generation because they can store a large amount of detail without using a significant amount of memory. + +

+ +## How the Program Works + +First, the user enters command-line arguments to define the pixel width and height of the image, the number of threads to use (t), and the total number of fault lines to create (k). Then, the program creates a grid to store the height values of each pixel in the image that will be created. The grid is a 2D matrix of integers, with a width and height equal to the pixel width and height of the image. Each element of the grid is a height value, and the grid is initially filled with 0s. + +Once the grid is initialized, the program starts all *t* threads. Each thread randomizes the height values of the grid by creating fault lines. The following process is carried out by each thread for each fault line created: +1. Randomly choose an entry point and exit point for the fault line. These are any two points that are on different edges of the rectangular image/grid, except for corner points. If one of the points is a corner point, then the other point must be on a non-adjacent edge. +2. Choose a random integer value between 0 and 10, which is called the heightAdjustment. +3. Choose a random side of the fault line: either left or right. +4. For every point on the grid that is on the chosen side of the fault line (left or right), increase the height value of the point by the number heightAdjustment. + +This process is repeated multiple times by each thread for a total of k times. After the process has been completed k times, the threads exit. At this stage, the height values of all points on the grid are final and the image is ready to be constructed. + +Then, only one thread performs the following tasks to construct the image: +1. Traverse the grid to determine the minimum and maximum height value in the grid. +2. Create a blank image with a width and height equal to that of the grid. +3. For each point on the grid, convert the height value of the point to a grayscale RGB value and set the RGB value of the corresponding pixel in the image to that grayscale RBG value. A grayscale RGB value has all three components--red, green, and blue--equal values. For example, one grayscale value would be (r, g, b) = (55, 55, 55). The higher the height value of the point, the higher the RBG value will be, and the brighter the pixel will be. The height value is converted to an RBG value between 0 and 255 with the following formula:
```RBG_value = 255 * (height_value - min_height_value) / (max_height_value - min_height_value)``` + +Finally, the image is written to a file with the name "terrain.png." + +

+ +## Executing the Program + +The program must be executed with four integer command-line arguments in the following order: + +Argument | Description +-------- | ------------ +width | The pixel width of the image +height | The pixel height of the image +t | The number of threads that will use to create fault lines +k | The total number of fault lines that will be created by the threads + +
+ +To execute the program, you must have the Java Development Kit (JDK) installed on your computer. You may execute it with an IDE (such as Eclipse) or using the command line. For example, following commands may be used to compile and execute the program. + +``` +$ javac TerrainGenerator.java +$ java TerrainGenerator width height t k +``` +You must replace width, height, t, and k with the integer arguments. + +
+ +The following is an example of the program being executed in the command line and its output. Once the program is finished, it outputs an image file named *terrain.png* in the same directory where the program is located. + +``` +$ java TerrainGenerator 720 576 6 5000 +Parameters: width = 720, height = 576, number of threads = 6, number of fault lines = 5000 +Execution time: 1851 ms +``` + +

+ +## Use of Threads to Increase Performance + +### How threads are used + +The height values of pixels in the image are randomized by repeatedly creating a fault line and increasing the height values to the left or right of the line. The program will perform this process for up to *k* fault lines before terminating. Rather than creating fault lines one at a time, it is possible to have multiple threads create fault lines concurrently to reduce the amount of time it takes for the program to complete all *k* fault lines. This would reduce the amount of time it takes to produce the image of the terrain. + +To parallelize this process of randomizing height values, it must be possible for threads to modify the values without causing data races. To ensure this, the program stores the height values of each pixel on the rectangular image in a 2D matrix where each element of the matrix is an AtomicInteger. An AtomicInteger is a type of integer (available in the java.util.concurrent package) that can be accessed and modified in a thread-safe manner. This ensures that multiple threads can attempt to access or modify the values of the same elements of the matrix at the same time without causing data races; thus, multiple threads are able to increase the height values of the pixels simultaneously without interfering with each other. + +The program uses threads to parallelize the process of creating fault lines and modifying the height values, as mentioned above. The number of threads used is specified by the argument *t*, and the total number of fault lines that will be created is specified by the argument *k*. All *t* threads create fault lines and increase the height values simultaneously until a total of *k* fault lines have been completed. Then, the threads terminate and only a single thread performs the final task of creating the image from the matrix of height values. + +### Experiment + +###### Description + +To test whether the parallelization mentioned above has a significant impact on the program's performance, an experiment was conducted to measure the program's execution time with increasing numbers of threads, while keeping the width, height, and total number of fault lines constant. + +
+ +###### Parameters + +The experiment was performed on a computer with a 6-core, 12-thread CPU (with hyperthreading). + +The following program parameters were used: width = 720, height = 576, number of fault lines (k) = 5000. + +
+ +###### Process + +The execution time of the program was measured for *t* = 1, 2, 3, 4, 6, 8, 12, and 16. Five trials were carried out for each value of *t*, and the average execution time was computed for each set of trials. Before the first trial of each value of *t*, the program was executed once and the result was discarded. The reason for discarding the initial run is that it may be slower than the successive runs. + +Once the average execution times were computed, the *relative speedup* was computed for each value of *t*. + +This is the formula for *relative speedup*: + +``` +Relative speedup with n threads = execution time with one thread / execution time with n threads +``` + +For example, a speedup of 2 at t = 2 threads means that the execution time of the program using two threads is twice as fast (takes half the time) as the execution time using one thread. + +
+ +###### Results + +The following is a plot of results of the experiment, which displays the computed speedup for each value of *t*: + +![Alt text](/experiment_results.png?raw=true "Sample terrain") + +
+ +###### Comment on results + +The plot above shows that as the number of threads increases up to 16 threads, speedup always increases. This means that increasing the number of threads increases the program's performance, which is the goal of using threads. As can be seen from the plot, using just two threads instead of one achieves a speedup of 2.056, which means that the use of two threads decreases the execution time of the program by just over 50%. It can, therefore, be concluded that the parallelization implemented in the program is successful at achieving significant speedup. + +It appears from the plot that between one and four threads, the increase in speedup is approximately linear; then, beyond four threads, the speedup appears to increase at a slower, logarithmic rate. The speedup appears to eventually reach a maximum value of around 7.1 beyond 12 threads. It is expected for the speedup to be non-linear because not 100% of the program is parallelized--only the process of creating fault lines and increasing height values is parallelized. Amdahl's law explains that all programs have a sequential component and a parallel component, and the greater the sequential component is compared to the parallel component, the less linear the speedup curve will appear. Since the speedup curve from the plot above appears linear for up to four threads, it can be concluded that the parallel component of the program is significantly greater than the sequential component. + +Another factor that contributes to a speedup curve being less linear is the overhead of switching between threads and *preemptive multitasking*. The computer used to carry out this experiment has six cores but is capable of running two threads simultaneously per core due to hyperthreading; so, it can run a total of 12 threads simultaneously. If the program attempts to run more than 12 threads simultaneously when the CPU can only support a maximum of 12 threads, then the computer will perform *preemptive multitasking*, which means that some threads will be temporarily interrupted while other threads execute. Each thread will be executed for a period of time known as a *time slice* before being interrupted to allow another thread to execute. So, some threads once after another, but not all at the same time. As a result, the use additional threads will not necessarily improve the performance of the program because the additional threads will not truly be running simultaneously, as there will still be at most 12 threads that can truly run simultaneously. This can be seen above in the plot: the speedup with 12 threads and 16 threads are roughly equal, at around 7. + +

+ +## License + +This repository is released under the [MIT License](https://opensource.org/licenses/MIT) (see LICENSE). diff --git a/experiment_results.png b/experiment_results.png new file mode 100644 index 0000000000000000000000000000000000000000..46677efe830f37144c086e909c67bf9e2453ba4d GIT binary patch literal 23914 zcmeIacT|)4*Ds3WI5?tUBd7?>=&Ps%8Ak!7gs}jlh=>XV0t7(;DG9xW5ET(60xALu z0tzB1HI#%Jqy$u&^pen}NC*i8l0e#hf>YFiS?9g?p7)P)ep$ePbc@6OUN4MY2J;lT%t404-)gjZbh>2MWPoFw|$0(R&{Lc=bnrxcUdfo4=*R|J1F*3Jrq1E^)ar7^)J~ zt&j{qrOv3>4m_CH`a8C(fG-=HtrDW2t5cw&uWisPI8H}S5UKX>58f5qmcMlLx8={- zM*0po_05}oz}Se1{h)^vef{!Fm}mg5-!KM?ey+c_?Ct)Wrw(SkaBsB7`qxW4xTbER z;1$(euClh*k0#=JqQeK(rcT*i?F=g}lXl4INfi8^YnPRDylFN{0>6VYc3UOO8eP4& zu1u9SI)I%YAG2g|#ow+ATXX;P(CSo7?g#v+fvKQp56paE^k+vXc=jSbx0k+c1I+4i zUf}c{!-JG{2npKAYE%lM<4n()1-C>=*ehO)a%PbmbZgV6N-${XxYI$if>$9HY<8?g z3oSCAWb0kIm+3F71TXX!4p5WK%bC6>kJb&*?_0wdnw5>kMOP)F^vmeMwyUPpKR?J- z?r~nMX~m)iQ%pn08rO@Etht~B;=VA>4|$cWZbTE$&cJ)j+>4H&(JLpLc7C+o6oe#8 zSrVQ@*W1KW-SZt!DcrgU7F&PQcGZ;&mvD^v5_G5}6z9fLX^bbXBke-kr8>Aa2$7uF z`Hdu7v8`C;tr9;e?F0R`cmBY}q5b-O;>qCw9S24q`aatv2r0TUdZuHNJl&oG&CKbp zYSu7PEXnnLZ^C?pW!Slr$Btgk{s~E0Wyip|iXVKCcGx7-LilUZ$w!Pg2Nr%x_s;$3 zz-{1~sz8gqj&d|~3L{_p@X}38zAj!0I z5rP*^afSW(Q{ghbJJh>{JUWy2!fa#J!cjXJJ0o>x6~ox6BP-%VgoBj!{~g%V^wmLF<7i!C~iq^cI8m z*ID2Oyp?)OFFOdIn`iPqAgeB6Yk`~$Hlmmjl=QT?7biptc-Dl;!ZY`a`Q!O*-XC+q z4Osb218^BKaon)-@WUatj@q^H4242gP80nV9SwT(Of;H%wC!;GRRzWsju-ob1Bi2R zR<80Cj#Rr~HTp6aez$t{4VLZDfEwg#KK<678ZO0oJYI@Img*i6oai+MZpZRi^_UGQ^Z7pQRa6odd)%QOz)S&j?dm@01_&jV~A8S|0p7L;)qf zyPw}|`QuoP=Hpjq{RwjU9`im-YeV!EWcvZN>E>&n%B+}3wq!td;*U}p~y-Eo1!Jylj_beN(mD^4ea?TYSG@Exb7 z<2?Fn72yP5H3@yryha5|(I>z8yKP%Z-@Sd2Zo3Jx4<)W~ zQHCrC+o5&cN1%FiQcPKE<3wO>vH@eB(3g{BJEQ>i+Ir_DlDWMDJCHFl$O1oquLhg6H zonZRJ8x5X?Ca=H5OQ7{#>m%=_Na>&9PX|hJ z7oLP}FAJWNv)UpZA!q!9x@SSo%pr%1&RgEEF6^zWyx487)5qiXIs=%Rpsq(=To%q35{l+EpzJ61Opi;enjTfq zl+)SR?{Sq_Ryy zO*XN1Di%59i%9HTzs!YiNR&W_|9MUsD(@d-;vbwCd2Xyb$oV;GKTc3$9 zn%}mYMXhPjZErqMmPKWseyko45eI9fKg-UMQ5AolZi|cmbEkXDNWiJbG2B<1%cU%K z&mG;!P~inR_)vG%Ww~-!d(&4xnFvld#WV1OOmc-!)$yim7vlFc(-=90qqXv7UK6`f z^dw_SrN?-YF`G7yqV6dg7;8=~qr+I~?@$c}tceBs}ceuR$LxTOc95UyTg5 zbTzXT`U##%Q*@SG^JO^KIcL3gO+?>=6n_{nBRh2-F|_BNVj0ZE1EAAf>$eqex#d|p z>k5#i2SGQ8EOW8oWT@DatyW+)Bogxz-9OIoR{H82jI9xk5~}E-U_ao=fz=cloIXe` zl)R8E2}Plkf+rwipU{Kd3-i_VLzBdW#kYw=7oP`a9lFU?&EJbY=jZM^S9#6A%UZ}{ zSlk?@B73L_;u&bPP@7c>K@KeJWaU?|-hVKlbQ{}+FmY`&s~_5KvM0aOSVt!ZJs@B_ z$Gfnyho6=f@!b{wS}Wf7aq~ZwdE-8wlfSguO8mQW$#Ye!pRf+0`ntNPKONxg6jJ+& zCggH`?AO;#X>oR*@{M8GT+^318oI}ZT#0xTl*i_5cZHO;LiBR{BT7D$Hq*1xOd-NO zdPoi&RX2cYCvFUTl2n^!x?N}Ls-}~jK3Pg0%?}iovq}XB(L*y2)1#lq7A=G=nooap z*!c6#j5<2Dd_O2rE+@st)hlAt{CvQ@?ZjR)9{r6~lgxGEdC?j-0c&lN${sR!GFJOC zGjBnICZG;gTpgW>#mndJmi*pAd^0U=Z9&Dkz`E7mOlM?5SO+H)k)*1lIQG-)g=3+# zp4PS&@ywy)V|a-+J~M^iRVch+IIp#qF+O1)|1_)n1eZ-|Ao3rDHU_7%Vn4W`wl~vq z9Jg4D4~Dl062&V~=zB(ma&EMvD2`cxN;N(l+Y(0sfeZk#rfdQGA^W~wKG z%VL+$Z{F#p3dhg?-gU#3I{KRfVa%Uz7av~K?@-DKW;CKZb)L~FDn2|u{VL9pmJ*U3 z3#C1-mJ>E`l|hM(RUNDg_;{UqmTxTkY8iCOPcDSn&f@#Ci?}r zApf8vM$Oju&&dtj4~mznAxo_<>Hn!&htcEnfp%BpsAJ*)Pme6?;V;!YipkB0e&;IH zuH28#A>!x9F2#@3$ejuqFqm6qALYv^;BTno1wZJ@Y8AY+G3Et7dQWxjDR*_rqiG+r zz)QvmDzghQIsL0F=i=QKJoEVB<#8jX2ffRSdz*+FU9+qY zJs_wc$X8YE@PG3uww+NYU#|pNu zVUr6|lKd%gcQzgKA+MT!xeBX$W&7H3Ta~a7WGMBmFp=E8%#?`D<0Z*w2$ zjPLK0982bpmy`l_#0CJ)l4XhF2I6my3;M;x5YM4vM;RhC{UXwK)!-WuG`|lCTXTJN zjyFTjGd#3fa+dvrn484^815D!_|@EXAgoGO(7dYBsAo+50<2|kGrTZhH|H1N;B_K; zK8!SZ({L=(yf}c&)vxZ%NnoF;eaxoMch-pljX9c<8F+_MzG;I|Pn8p6D~bO)T4E{o zu-OPNcL48Dg*`rCLG-FU2)4{+M%B5vOzuiMAv$w4XHr^X0C2#Oqp&XMJwx-WS5-N{ z-^H%?ao$T~_4vt#;d1%!-mAh0Ca_|^+B5N8mUH8Mz5}jJYh?fY#4Eup9@au^NVe6c z_DMM2$D3yRPf$&jBh8;%7IG_09H?;G!%l03!zaOA3JvuOyi29Y9Wth zkn~MqA;6z48yYQv3t?4XokReSllnySnoF4O`u_`$v8h|)mE`lDKYt!UOK$`tzh__b zt&17ZaU~6%G=0i_q3m1T88hx;>s2(rP_3(pP95u;EOjna%JECu5@D5lH{UF?bJ51= zwC4%jo#VIEo{5vkk_wJG5P~&T{&K@ICSSwGdkl>&&mK2_|Dn3I6fh4tBp< zh_`;i2&>^qsA=%5;!FM2Io%^_<(v?mJ6XyJ^Ji+)+4REBan}7Kid(VUwn_j~R{S`= z7?@a)bDmM*F(m}o8Idb(?@~<7$@X>epMDhn1KWS_E}a}5=j#^Dh#k_Sg(W2H`<}3Y zJW=yh*;l^%M;y}m>RxuQbiBOwm5?W?gFUzR35dM&Fr1@b-_WBCNSG9ieGS|Uz07&k zIPfFH583ik${2h>_v?2QZ|Bw1ewIxj+LEQhZ?4X4k#Xr)*%BVl>TSc=R@aSB*>@RR zaN)P<0ez##loE+o3iUWLeM7f`OT9!7u-i9Rc)R(?T)R1V+Mi4RQ8w{0+sWIp5tOD+ z`!JW>$Ly@+y}G$U#)w?Xqz9~7beGkhhoqfIy=(hi7ojZUdAQ5sW2dd5WR)fZuH~BY zVEh>d!Q6t$%i74B9IiLrsd3q}5LKysqo`uNI=0@8`V3rjIvfpC+EN_MN1%@1X*CD; zo;gL8OpGAMaZzr3(!~CFScGsL@x`&{(3)po@1$Txef3H0#1Mv5k)ErqfH^o|Jq;&r za_`lrz;6dL+d`{6TiN1VyeY^--N<~>zs09C0b*zD2pUHfvT5xTBWi~TANzJ#^AgH1 zij6;#cKtv)0c`4nWA@pFZ?i~ol=9BXu9M{V)i3XO*6qgXeuUrV2NyDStk1@ED|^sQ zGk(#BtGB<(ht8GMR;lzPsTnO${o^jV89Z9huSd)e&Q+Y)l~v6Wot5huK#k1aF0_4aM~g5kN+yUlO+EH@_Mr9Ph1rD_y! zMu+v*o2zk6W+6_R8~$rir8=pbGP6aEFUT|7&l~wg_|z*A*S%pSTUIQg4L_7Nvi*); zWA@X7y>3jE{A$+x$VL3Nr{A@5RjPfn@Emm*-GWk9JB;jw7)7FCSW4f++L!-W1%KPq z|8tM|E+YE+b3b`j~L~C52 znp%}e2i9zuB3opCBpSmBIuQ33`F++Cy$8|frKStjACBF!-4y)wK7LuR!wLAH$yrQE z!z=iqeHUdKtA@T~xhk7^=*&`@3ADC^c%e(J_35}R|L|5%l37$YZZA%v(P5l*ruFI0TwC{n$>^w<`cVzMh|M$KUDS2X_$xR2ZjO_t zvmg#N7PlV4$6`7RC6+E06&6xq3}&5QA_DD9vssu`5?^oOv(0y3k>0M(W+{hDSh063 zowXlyK}31j7Y}D<&2ha#Lce+EI!wsZbl{Y5+XwOCM&@a>9|*Oe$ds*2?sV%F#xgs`JAndOX$_h(wT<&-}-q9|Sj zb?JUTbvULTfJT!DC*2Gv$FuS?0XxQGaX7*$|AY|XY`$?)b?w-D7Avr@I5L!5APfQt z3UyJ9LJN0E1kTYizsL5nnT%_wU+q^m>ujv>VV=OC9xt;FqbY1c-b7td;Nn5WrF+8B zzhOV)nj}=My_t{jfYjHH>q52807Xd6#u$bu(cznH2Re885?>~W5PPSG>fF-exW z9fL3XzOll8??1?WQu6%fe0>*>%ejQfw6DkJi~sgU1}PQs^`KAQ2e!AxwXt(M;{UM- z|8wj=q%lvJ?+c6sb%X$#ZNpmVKW zx6zcM#u8S4+o$|B3YU6q0+uvX3F!FQ95r1#dr$hdJmC{b!x z&3@3KeIVe6$02o3?esn%m?~>VQEsn0jHk>$Iz_2tiF5BtdIBMbvWKt1*NZ-QQcL=^ z%@&6oXqNuZ-3@4m{=K&q3PwD;N{zh3xZRM;IxUw)07Z8iaoXJvN zLf+kl=3p}3d9*)w^ht`^k-+z3bT8A;qDYzoYm3}c=<;zo=7`#tkcVx-du7~65dq?z zVZ>iFr|r0R_@_dbK&{Ap7=D4LspT=3z>oq>W}1uN#1cv;+}?3Wfec@H=+f03>ab}v z{-|cZ&a?&Xy^`rpNqFNY&-f%iN3w2r#Uew&WttPLrgaD@aByiW>gU>V@2zbEDtO z_|;ae`n+WRaa~8;zMdx;^J8o7hA-;I?@$7wQHz0`{BvKU|1W~rU$DB*T{^gx8}NvZ z*~ilFO~_@}LV31B&Ho6K-AKu}U!6&TTvbr8^uNW$jD!8w6;7kL-KKH;?u@M)U==?7 zXBGgz+b=nt`!A!I13dz_#@j~OEevXd&zKU6hNJHZRvwx+wm9Dv2l&f*5k_awFLS(;jSVF{8#Jk%V$lJ_Zo!igV_`LERWGV zWvd+Xa%+OD5|%Zcp-7A0y_?mIjdfKmDqZ(AylnrO0FXDW4GBkl)WUSjZBr@LtOWHS zJIq={?<~@1DAWj=eI7r_AKbel%`*kuT}7wBED~ai37EE{662ChznqgO zxGF(t!z|uh36g1Ql5CwQXHr|6@KHH1?{M1|35nxa%4a9}C85>y_SN~GQ!AOIe_IU+ z4{Y7*OoIdwCI_PB$pd6=M?j5|UMhCQN0KEC2X(v;xq~er;~zxPd&VpKOqPts`xDc( zjmI=0T31ezj%BPNxGvO;g@w8}zU6Z8ON0_M1@GwDrYno+S93|(;)&mBiIQgH_-`P| zx`@ABqmN!9uE?2S3Mp_Z?8Wh;OsoUn>&eF#umu&Rm1ys!TlKOj;Z!wWUZtt|9WW?C zZHiVA(0*Ibh&l}Kx&K4>~!qzZ8cYtl!9Hhf49R&Wz3Enj6U_};E52%)D+wf zH)DXBf2ThM8mkf<)?zgzHNz*2`t~L zYj?Sif8gE$6?;Dx?XU->u-0x#%d&Ej(H~9p>wuIfQ2y(LXi7SXW2`e(a}(;W0W+Qe z@aaB|bL>u7xX605+D^^)@NiGPCR442YJRsU@@{S`ia!H@+TsfSleJ-3dW!f|7krgQl(+q_&`9=*~qUa$3;9FH*vAupeyEpsT71FwPZu` z9+Wb-W3x8nb{5>|G-!of*}_aBT$RLD2m1t02Si@jG>_v~e!ZMntCT^2qm&fv6koC+ zJ#P~(fz@36$I>@!NXlE#497P(NoX}=zC%>kQzQ7{%w!ZNGmbth;KgD^ed#;JB zVF2k&@y+N1>NjP3H*lKBt3eVn?=V5ATVF79U)kNIOoaXvPJ!r}gmBTh`bj{8cW2Zo z^bBbt2iO|#C6<_YZ+cUBiIw)nJYM(qj78z}mVdG2Az8hlIS|*~#ZSX``u7rr!*E!! zB|dhqftu+yoaOW;Zqro7^h5$dc3#QnrPt9SKTV`v6cSn}xXSpK1cAc~sNZzQ)NIBG ztMLKe%xjkL07-u5X_iTpQqeJ5$!aDf*lsGS5ENU%7q3$JN-+>za~FGjLssC5sCBy% zi0x7?aOS2jKF^|*$Wrht#{cabygyQm1Ejo?NM)|IL;WdEjQ3A$@&iv!e)|z2QoC(OX(C5W7wpJb0i+O z=Ir%JAPpz>`B70ZN{_P6;JP<~Zi0&2n5|QF4?>dBoSR*A}8NxD`m={K0`QUEr`sIEhXp zAQSTRJ^eLj8<;+`&`J;eGpu23GkIpWfBk4gZzKpJF`aR8Y5FCK9s0{a=6ibyvfjcc zO)ho{ExQPRM~RxdNmW2DM1Xi7p*nD_l(u1ZoubPkJ=RsZDE5z8`bhLf?an)UD_(f- zw#2ssaUQqUCGc{R3-Ne=nhz>vQ{ZorOa9f&17382dSEMD)93lZZ2mzl*wD9kwj~NlIlHJy_)5=5*}*;ad;t6Sf9)BZOc)yu{WZkT0lUID@Uj$_RH;ExIkdG;q7_%g@mkPiLcFSzW6 z$VvUN#JA|Bs;7f1D;~`}1Gk-uc4c(XVLhslP>a6PdNhDXB_Bn4s|> zkMU#wPdQSeb?{HmqX~erdMR2*N@RCZBDcFF=cS`G_CeY}?m!s)r?3^FoMso)lJh{D z6|O_@R2cXX!R#wstTJGIRFCMX#}aOmMf;5Vq|~_7)90|B zVHZ4#y^(Z6>2R^Ef!f7w_>*nezO=E0(V-9f<16wDg(1bV^@mNjA-GV~lV{MW9|02n z>$G*kgNx7efIM7uIK?+hO?We0GNf6{#TV(`E4cyF7G?z5_Ox~Gnf4*UfJHO(2%`7z zJYH|l-8$E~c5X}BiSTpXJtT{o!@D$=dt?+GODcy|;3xIfU9>sA^;Q`wi3FLXg_q$U z+BC;8Ot6MlqkF2Qu&oDPKE~b zMfh4f&rF;~*M2U- zlt18K@3T`o4m86cX1Nze_1s`0=iBqH+#cJO zqE?XgTY;CAKF%Brno0qPIjuu~E=$13JB zb(;2QS_Qsc*N;YWax_$d09tt|Qy0Jn66ZH%ex4vLJ5S8RpvZ1tdtu>x7p3rZ<4$%` zmS3m6Sx{G*QGJO?y&b=t=`(UM$UdJ`7OrK63vjzwc00?gxw{*Hg4w7wz<90yB7y&f3FMlA zwb+xfQyt?Gy}vVe(dwo+b7XuTt^GdNhdXP)GNjuLWCS`5?divL=2-Yo-3dprk=@}p zupv4!E`NQpU9O$p0qh;!dTm(6Jd%YZ@Y~L609@_pLq4BtlHqH`-*NS`QpGQIzJC?! zJlOIDe}M*QOa4+7eDP4*_kmFFR5pin8npW$QWFx-6o#y1Te;VzvFEhxhBhyMrGID_ zzPO8c8Fc;am9DF42SBN;E{v;!iB3T@jLY32gse!fOl`#$M$)nr1lJg?`Nw3BEhM6+ z2Z$v$QBn%|u`)@Mi8MA}Kvsr`RT=5kp-u zu5n0#a+=S4tX8jt5uE%pfvrRc7=7_MC>|&~4!qpxh3Nq#g%E46gBRshfoy2*mWx=Q zPr*U(4}O^9qNH5pH=>+BVHMt3Q} zd7*{4aJ5=`Ia4a~mDA#;0x5rPr$HHmnH)|mkBc;K4+)mj>3qkb{6V4y zfR@cX^rHcmv0bTSFtKNBxeavq0yxmu^&&K^OwVWI0R9Ezj zCJBn=w*P2^Inetq)}F?nOvCRD+LP|HGy((ZIqGof*ZJoIX|E(2TZh)ku($lvnLc+0 zH%#aBJ*=Ce+xLJO7Dv={G7J3w4w z?&{Ids70!0mg-3I+^~#5|E9ZMIR?efZ0wmCR`N;p>5?5e89#$PeYrM< zO(#`zNV{vkmBWd4UTt0@WZo^~>=N1_UdgAMvH7B>30_>{`21}9HIgnm{-u$Ut-M{% zH;e3j{zu&3Jnp{o)xjs8L%%xjx!QX6ZUSL)+4EK)`VQ7@&d z3G#QQ=}GlW%tfR9SCckY_<1ccbzdqD6I!r@{2R81?)<^`eU_XRWm%1TZ%tv{y z(+x>^L(fyx^2>(!`Sw_05oPg7fDi*D0_8c2x0JK{ocoY-YvS4Pg;xth20kU6`_lH1 z0$D-EIl~Haz>nlXi}ipeN$xM1+TZ&v-dU7KUF-<3zsy_=ZKU05^xtzCg)2gM)>Q*) z&H?%`aw;6#(fLaP-Q>{Rp#2la_UvwR;anQSE@g|44-U_C(7W(PMgB8^{8h-90_6=I zhVd|h(sDwcJmteQ9zECT%p$}(TcuUL2w%~~{=snn!G!hUNU=oMVq{YOo|&Z7{ePyG z{{a|_p_x75k*`hpBw1E)r~=+@l$~WUFX+Rg-4^IBi`~0pP{StN-+4dCd?ru+R4snt z`MEIgq_mPQaoweH)-5zW3-0*`ExSy_%U1@mCr!~pde&@yUi7TLYWX*&iKJG1Elm+pHMkR+PG^KzJLtV^YFUG=m)1SH?)zo_&k;8M5!2 zG(h>BW9u!ca}cKXS)a7k*W{8Xes+7|dTe))#S38tnvHDoL{u(+@!S^ZQ_h3$uB$ z_+PpA!g)O~pAo4>sXAuu4wZ6yGb%hT3*(ZXS{9rma{1UN4D!swHkt73wbSgpFPk&ibCYT^WR@-@mLtoy1+Eb zn2dyjdBrvc4%h=*5@7A)fAY_``To|2M|^H$N&Sx2YZHNxt56vA+^=?*m9cKJr{|3f zDrp&e3y93CbT&+`QHoaSejiYsDXQJ9OvJf8P}0#6UP?>hto*R|`h zPYUp(YTT)D9Y@~pN{1IR1)q$D#v??eeV@;aQ~p-$qXiiUed#c_kztzGa^V0MP-6UH zIB9OErgMqhH=Q?)%$`GEG-J%og`-!=5~N^7zhd(>%RB`44czX~+OUvXy85&_JfIU3 ztR<`vR9IClyC5>5l>GU{99qg`DBgpLa3c#=-T~)uP;Phs;!slW?{2O&Z{M+}JcTSk zJQv7$Twdmv;jg}D#em@-1ahn-EPLx03^KWoOrgpDi@^vHW}Xrp;#!Yh3meF{eC}crMvBN?p6>%7NvQ&KLFXe4recLx zna*)l0Xdt*9}@r@Lk6^A5qmj+9lYO(B(&|;P)Xqo0x9y~1P3^RRrzxR6- zr?65&ns0I^SB`F8KsnRhtpkQVxT?3ErS{xEfI6>n=3i0+2S7K%Ri>g+;TDA!g_ErS z4Lp+QN?9yq3zK@v2M>NuJTAM+EWsk015;3eo=-CknlCFC8pHgHDxB0`)5*m$!iI=@ zAA1jub@p`GwxstAQwpR*MM+n(o>32FHeoPWt~163k^G@#;6pI0rUpZ>NLg3~dn&&H zAw}4tW+vgVklg_i*6!5{4UW`ytQ*gUF)y-LNkEq?n-D>q0fb5n?R3SFTWQ+iT33ba z(YUOG{DvT}Dcqosumr2nbBxZ)X+I1qJf>+KNXl-X4&V=-jNcD&JQ=bbHmxx!q>L#F zYV?fC2f$mxd%3K+E}_-=jTWTg4|BFP6n_OPAkRn(x#~&+p`vA0fpV9t6Dh}#l4qPz zBcDXN0Z&$&uL@ZlD|8gnKVDRut-%!F^!0D5*K;*Xc{xdBJ;r{go@3IJiCu@!b$?(0 zoL*ZCc)EdH!!V9Fmvs1)Xcf3XR=e~x-@*mQka!1Rw1Gej^Q_IPWhnrFmw;fJ&qaL9 zI*M|ow#y3f$d4``Irq?RFh1`TVQQ;H#rIlU`S)~Po5JKmMq-io$j?u<;r()$m(p(< zJ}qz6Fr4g9HdF}skO&THyB!=U1t|KtT6Qh!%h0+2Ow(l=&a5+iO<9XzP;xAa8F$d^ zETfyUEHl$E-I1}UataYd!BGFO*ZEyHWwl_WT}97dU3NBbDBnDLo@yTU47$|_?j#*v zYZ$L%GT~kl{lf|qJ8nCZE2mU35U^$+hPwn{G!YW`NW=u(O>GOwmKJ6hDc@UmJJ}$| z0lZ7%1R2n)*&cFg!@`(5OfEcvzWH0a{{?*qk-_362vPW)-i#9qaWbwt?WLDE0hV@$ z0Hs-2jrDrhUV@8>`AEnkYd*f~&2M$c#kA8C3p);E{mZr=}k0Iw;} zA?@64#-=}3JIQ1B6xxd{lGg+!BWaXDaVYjyW7Co^l@Fk`8BgiTi|dpJ|H zL8iI4HI9Av^4%xI;f_dt<#$Ue!GA!x9OzLS9jq?1C%6%tT}`_$Jr4P_4;1vI=t>$t zHpR6+&8ALRzc5&GH_qyq6{YMb%F(N;>0l>5yKTZxhy^74_^H@?=&I$f4rr6|JZ5|< zmd~(!B@FzA5BLII3T>bcifD%FY&BQ5v_*#XeX z%T@R(M2W=>=T?^Ig|Eq6wpgqTFq5#t3-}8VhvKJ%@XvK_HWlnUBVv0zT~sF$Ri`d!?R3) zi2eML?2m~7M3e{|RHQS!8E$A*u!yh-sf%_1^V*(92u800yxN5A5S&8$&Wx?OjIrX{ zfUsk_Wc?owNJGrRLYh@%QWfBRru*dODn6cl#lS5)e^bF`;G1SQ-$$Bds{QtgQG5w} zBB;_2MRXz{klz!Ef>#)X&l=8~LV+|HzZ9mSrk-L+Rdpu-waw?O?Uz4i#nv2Pg};@wp^`_aY!s^xtrAMIS_Qm z_UBW7*Dw9er+ep^@gxpdSJHvwee^j10>(42%Xt71_jB`b!7>{zJ| z)M%@O>hh89R&3%vkkj&-;r$@1P8WATk#_qw9w{lkUL<$;tP=Z@djeE>m6{@&dpW4} zKR;{V*7#}sRW18J{Vb4YB-;+tgNe8cM4Qz2;e+@D7%_-U6vBlhNer_8+*#$`hWM^2 zwk$h1(q3VCIRV6vlq~9DROjNsdTJOUH(d(-BmQ6eaTVj+nIy zB0YKA|UeRH!MhvTJ&5A2|45;+_EN3y7SZTr?M|5^?G67U3B02BEWxGE= z^}{0TyC3Ar!xp5xKgAt`cPDsf3wX=dJ6{C%a#DYOefBTi&GK&mEbVH8dO53bvJT7!*8` zAWGdX=WV|%lK8f4`#;D2GiLu;6Mwfc__zI_@W!?!cRo7IFk)0Ww%+_8Jnyg>wLgph zO&R3hHXE>iOKs6~<1NztuMQhzsPMXLXPaTEtgCLJ2`iswLrNZ+58GcaX|*Xh`ONpED(U4NXvMB(=vE-Y z&Z0{c@ooR8(F7_r$68}za-g^g?{Ly%QL8w?2B1I1GdLV)J9IbDBz->&+Se%2Bx;k# z02*b4!1rbo?NbA@=OG}wC?8@;DSN4B-iKLf@KO&w){g%#tvzhbcHoH~mG4F5u}P*p zCGJ{yiHXuE-gjqG-uw4XjLP*)&!nV+Lpu2e#V5m!vVNVWDHcbWz8a81G-Pu-@}#SZ z5r{QPCW!A98uR{Wn>TxWx?0V8;RuJRaL-kkYgkz{?~<~9%sXBfT{yEco!AlC&xC8>?I{5MSOWC;e2yX zW`eo+7M2ER|Lr53_gn79Htvm)xMK&*DeY5Jw8O;|s7^hqK7NV)1#<j-~1 zGZBYliSy?NpdG2-O*)IJW-Dvoo0W&YUJnE6w0J-sABhq&#st0o^f%58T;G_B;@sbZ zDE2uE+z|Hl5{4ap0O$=ER|wzh9(jo1a(Ol#2uehm&80>p@AU2>rYn}byYI7M=|orY z37`rN>E81zkJARE%!a#PG&U__{G2g?#dK28&-A~s&y++jeS*bS%#xqah zet&?;9hKV#238*}c`!C`dV9Q8&ss$N%ds2Bx%3FGiIPm7HQ1s;Q`8Z0A-6~C8QA`) zZ;jpA{PsfnZu7vMC6}XHAIOjX43zmP?}zCrsK+-4)@l)tu$h4@$w1V{Cf103dqBMh zZmsUXD_^+oRY7V1Yh*dV{vnr zZYZ7(eZeU@jq6se3)A(pz)Fm}A!o-qqAW;3V(o^c*Y%5sK?%Pu#K!LHUrptlR)Sm3 z1gQqJSyk9N@Wk62;BCW6v8aaGRHjekfKk=zRf^f9AFWsIX%jD^C1;yB(iF{A^uiZa zXcyex$H;Ph+U@RP5;5Z$CtP)oc4L6M7cq)@<~gkkD9V8TPQTjZi+dH+cXz&s^$cY8 z-eRN{<+Ii!+UXDH#PoAG%sj0qVIXJVR1!Lg#^f3=%Zb19cIBrf)E zE9LVZWgYCk0zr~`oUL1}oFZ_+^yUiq&{B0QLQD+cfW)R=4gLo4?XFcy^4aXO-Z)#hv@C0|VHAtryWS#6>#BO1o)B3x8uK$qN3U1q} z#L*avx%5kb{8^+lwoB&Vo+jO(SqGoOUpp2d>cYGM29dueeuEC-FtY93G&8j$gT|a{ z93q*cF2fL*rxI2=brVQ!Khrd22P$g5B8c1x@ohxs=2CY7nn2?K}+GEe^cFsSQfG086iJ@)*&4N*{%Ap*gOJeQj z#F)+QZ@SEI-9Z`+EF7!^iPik2uLRCymNeBP(bHo$JnwsRKUr-G;FHRzC>m3&XuQ&E zj^`B=84pLoif7iy==(yrt@8^B8cBu|?v1}YOxL)Ry{3%f1DZl|n*G;Y*FLed8ohto zrj`Fe>oGr*dtGH#499%qHcm?BJ}ayP`tSt{2d@|L+vD(A`Os4e4T!r9qtrNAU7TYD zhGKau&BYr*8wkb3wV_8mRngWnkV9I7Yn`t;iomW>ZKgOp4iEI&!*_G&b~qKXllH-AVsqa`FoXFX!ShvmdR zqPK*puTSZe`<$hz?HhK(Ol*k&5QVz5>d->yCdI3u45dGWCXTPb_;T*<(>{P|WU zRSI~VN4sAKdiR60&rwUT{mjnAW2`uCQ4&1o5cjE>SodzA6||*_f76E8<5|MO~(?*IjU<_P8|d^3e{%EEZ{ios6zLpqoz}pE~SjB z*_pv)kLJa~PNmbS0W&NFpnBaSs1#mSN+{lJ*)CV+(Z(@2er;`qp5GyqpF4{D>bzk5 z2>eGE>Mn)|KB;1+FH2&c#=4XRKA+EL)R}W|;q!s`^t$}hjeKz6v60(+1mCwYr)z5< zcwzi|F%))bp_t(qk~0?K34JOpy%T=L-Ls^~%t?i_)0Y9sMa?AXaMtR}Iww&#)~aGp zop<87y0qGpn}q}JIELSvR~FY2#(*6p|4w6X6+ZT(Rbe#a zs#Cmz4pPPe^I_(IrE5raDZC#e{mL0jmYU-iAFG(pBQ5~FjJ4qiHQq5_NXpP?xla(4 zT0p;O#T65CJP-80ew$}+PV*b5CEk44!Q8%4>~|?(_O73mI2YR6a#&N4|Eqo!eDgN3 z3xK^6`-vKtrtY06*^%X+_4{+a;i^@?g#vH+&sN?4%ZC4d%c(wA;6E7prLSJX(FaR0 ki`e4vf9wDKo4rtHWM*+=jMkk>krz9yd+t>B37eb$4-WBy+5i9m literal 0 HcmV?d00001