Synergy User Manual and Tutorial. - THE CORE MEMORY

More documents

Recommendations

Info

Synergy User Manual and Tutorial Gathering System Performance Data Gathering Network Performance Data Optimal Load balancing Load balancing is the efficient distribution of the workload over all available processors, keeping all processors busy until the task is complete. Not all machines will have the same computational capacity. Some machines may have lower processor speeds or other tasks that consume system resources. The idea is to shift more work to processors that can accommodate it. Optimization is the modification of a system to improve performance and efficiency. Optimal load balancing occurs when the latency of requests is minimized, computation is distributed equally across all processors, system throughput is maximized, and the system completes all tasks in the least possible time. An absolutely optimal system is rare and can be difficult to produce. Optimization usually involves compromise. Performance or efficiency in one part of a system may have to be sacrificed to optimize another part. Successful optimization requires the development of sound algorithms and a functional prototype. Challenges to load balancing include problems with timing, communication, synchronization, and iterative tasks and branching that may depend conditions elsewhere in the parallel system. If tasks in a parallel system have differing execution times, one or more processors will have to wait for the longest executing task to finish. Communication and synchronization will occur over some communication channel, such as the system buss or a network. Systems that require an abundance of communication may cause a bottleneck in these channels. If the channel is shared between multiple processes, competition for the resource may cause contention in heavily loaded channels. Loops and branches can easily lead to non-deterministic program behavior if measures are not employed to prevent it. There are two classifications of load balancing: static and dynamic. Static load balancing uses statistics, based on the ability of each processor’s ability to perform, to share the burden of the workload. Dynamic load balancing shares work by dynamically averaging job size based on the performance of participating processors. Dynamic load balancing requires more communication synchronization between processes, which consumes communication time. However, the tradeoff is that dynamic load balancing can handle unexpected delays when jobs take unreasonable amounts of time, where static load balancing cannot. If a task is taking longer than anticipated, some work can be sent to other processes. The extra communication may decrease throughput but the processes will be kept busy. It is also important to mention that load balancing should reduce the 112
Synergy User Manual and Tutorial overall run time for the system. If it takes less time to complete the task without it, we should forgo load balancing. lxv 113
Page 1 and 2:
Synergy User Manual And Tutorial
Page 3 and 4:
Synergy User Manual and Tutorial Ta
Page 5 and 6:
Synergy User Manual and Tutorial In
Page 7 and 8:
Synergy User Manual and Tutorial 20
Page 9 and 10:
Synergy User Manual and Tutorial hi
Page 11 and 12:
Synergy User Manual and Tutorial mo
Page 13 and 14:
Synergy User Manual and Tutorial br
Page 15 and 16:
Synergy User Manual and Tutorial al
Page 17 and 18:
Synergy User Manual and Tutorial su
Page 19 and 20:
Synergy User Manual and Tutorial "T
Page 21 and 22:
Synergy User Manual and Tutorial a
Page 23 and 24:
Synergy User Manual and Tutorial Ai
Page 25 and 26:
Page 27 and 28:
Synergy User Manual and Tutorial la
Page 29 and 30:
Synergy User Manual and Tutorial of
Page 31 and 32:
Synergy User Manual and Tutorial cr
Page 33 and 34:
Synergy User Manual and Tutorial no
Page 35 and 36:
Page 37 and 38:
Synergy User Manual and Tutorial tr
Page 39 and 40:
Synergy User Manual and Tutorial de
Page 41 and 42:
Page 43 and 44:
Synergy User Manual and Tutorial it
Page 45 and 46:
Synergy User Manual and Tutorial di
Page 47 and 48:
Page 49 and 50:
Synergy User Manual and Tutorial Be
Page 51 and 52:
Synergy User Manual and Tutorial #i
Page 53 and 54:
Page 55 and 56:
Synergy User Manual and Tutorial of
Page 57 and 58:
Synergy User Manual and Tutorial el
Page 59 and 60:
Synergy User Manual and Tutorial re
Page 61 and 62: Synergy User Manual and Tutorial In
Page 63 and 64: Synergy User Manual and Tutorial Pa
Page 65 and 66: Synergy User Manual and Tutorial
Page 67 and 68: Synergy User Manual and Tutorial su
Page 69 and 70: Synergy User Manual and Tutorial [c
Page 71 and 72: Synergy User Manual and Tutorial }
Page 73 and 74: Synergy User Manual and Tutorial MP
Page 75 and 76: Synergy User Manual and Tutorial if
Page 77 and 78: Synergy User Manual and Tutorial en
Page 81 and 82: Synergy User Manual and Tutorial Pa
Page 83 and 84: Synergy User Manual and Tutorial fr
Page 85 and 86: Synergy User Manual and Tutorial As
Page 87 and 88: Synergy User Manual and Tutorial re
Page 89 and 90: Synergy User Manual and Tutorial p
Page 91 and 92: Synergy User Manual and Tutorial To
Page 93 and 94: Synergy User Manual and Tutorial T
Page 95 and 96: Synergy User Manual and Tutorial Th
Page 97 and 98: Synergy User Manual and Tutorial A
Page 99 and 100: Synergy User Manual and Tutorial Sp
Page 101 and 102: Synergy User Manual and Tutorial Pe
Page 103 and 104: Synergy User Manual and Tutorial Am
Page 105 and 106: Synergy User Manual and Tutorial wh
Page 107 and 108: Synergy User Manual and Tutorial S
Page 111: Synergy User Manual and Tutorial T
Page 115 and 116: Synergy User Manual and Tutorial Sy
Page 117 and 118: Synergy User Manual and Tutorial An
Page 119 and 120: Synergy User Manual and Tutorial ap
Page 121 and 122: Synergy User Manual and Tutorial Co
Page 123 and 124: Synergy User Manual and Tutorial Lo
Page 125 and 126: Synergy User Manual and Tutorial To
Page 127 and 128: Synergy User Manual and Tutorial se
Page 129 and 130: Synergy User Manual and Tutorial %c
Page 131 and 132: Synergy User Manual and Tutorial Tu
Page 135 and 136: Synergy User Manual and Tutorial 13
Page 141 and 142: Synergy User Manual and Tutorial //
Page 143 and 144: Synergy User Manual and Tutorial pr
Page 149 and 150: Synergy User Manual and Tutorial Ma
Page 151 and 152: Synergy User Manual and Tutorial 20
Page 153 and 154: Synergy User Manual and Tutorial ch
Page 159 and 160: Synergy User Manual and Tutorial ma
Page 163 and 164:
Synergy User Manual and Tutorial }
Page 165 and 166:
Page 167 and 168:
Synergy User Manual and Tutorial tp
Page 169 and 170:
Synergy User Manual and Tutorial pr
Page 171 and 172:
Synergy User Manual and Tutorial Wo
Page 173 and 174:
Synergy User Manual and Tutorial ma
Page 175 and 176:
Page 177 and 178:
Synergy User Manual and Tutorial in
Page 179 and 180:
Page 181 and 182:
Synergy User Manual and Tutorial Wo
Page 183 and 184:
Synergy User Manual and Tutorial )
Page 185 and 186:
Synergy User Manual and Tutorial Op
Page 187 and 188:
Synergy User Manual and Tutorial ma
Page 189 and 190:
Page 191 and 192:
Page 193 and 194:
Synergy User Manual and Tutorial Sy
Page 195 and 196:
Synergy User Manual and Tutorial ch
Page 197 and 198:
Synergy User Manual and Tutorial [-
Page 199 and 200:
Synergy User Manual and Tutorial Sy
Page 201 and 202:
Synergy User Manual and Tutorial Fu
Page 203 and 204:
Synergy User Manual and Tutorial PU
Page 205 and 206:
Synergy User Manual and Tutorial cn
Page 207 and 208:
Synergy User Manual and Tutorial cn
Page 209 and 210:
Synergy User Manual and Tutorial PA
Page 211 and 212:
Synergy User Manual and Tutorial RE
Page 213 and 214:
Synergy User Manual and Tutorial Re
show all

Synergy User Manual and Tutorial. - THE CORE MEMORY

You also want an ePaper? Increase the reach of your titles

Delete template?

Save as template?