Duane Merrill (NVIDIA) - GPU Technology Conference

More documents

Recommendations

Info

3) Poor locality within SIMD lanesProblem:The referenced adjacency lists arearbitrarily locateda) Bad: Serial expansion & processingt 1 t 3t 0 t 2Solution:Exacerbated by wide SIMD widthsCan’t afford to have SIMD threadsstreaming through unrelated datab) Slightly better: Coarse warp-centric parallel expansion…t 0 t 1 t 2 t 3 t 4 t 5 t 31…t 32 t 33 t 34 t 35 t 36 t 37 t 63Cooperative neighbor expansion…t 64 t 65 t 66 t 67 t 68 t 69 t 95c) Best: Fine-grained parallel expansion (packed by prefix sum)t 0 t 1 t 2 t 3 t 4 t 532
4) SIMD simultaneous discovery0 1 20 1 20 1 20 1 23 453 453 453 456 786 786 786 78Iteration 1 Iteration 2 Iteration 3 Iteration 4“Duplicates” in the edge-frontier redundant workExacerbated by wide SIMDCompounded every iteration33
Page 1 and 2: Duane Merrill (NVIDIA)Michael Garla
Page 4 and 5: Sparse graphsGraph G(V, E) where n
Page 6: Compressed sparse row (CSR) represe
Page 9 and 10: Breadth-first search (BFS)1. Pick a
Page 11 and 12: Breadth-first search (BFS)1. Pick a
Page 13 and 14: BFS applicationsAlgorithmic primiti
Page 15 and 16: Common parallelization strategies
Page 17 and 18: Quadratic-work approach1. Inspect e
Page 19 and 20: Quadratic-work approach1. Inspect e
Page 21 and 22: Vertices (millions)Vertices (millio
Page 23 and 24: Referenced vertex identifiers(milli
Page 25 and 26: Linear-work challenges for parallel
Page 27 and 28: Prefix sum for allocationAllocation
Page 29 and 30: Data-flow of efficient CTA scan(gra
Page 31: 2) Poor load balancing within SIMD
Page 35 and 36: Single-socket comparisonGraphSpy Pl
Page 38 and 39: Maximal independent setA vertex sub
Page 40 and 41: MIS applicationsGraph coloring (ver
Page 42 and 43: The sequential algorithm• Repeate
Page 44 and 45: Data-parallel GPU approach• Input
Page 46 and 47: SummaryPurely data-parallel approac
Page 48 and 49: GTC 2013:The Premier Event in Accel
Page 50 and 51: Comparison of expansion techniques5
Page 52 and 53: 10 9 edges / secnormalizedCompariso
Page 54: 10 9 edges / secnormalizedMulti-GPU

Duane Merrill (NVIDIA) - GPU Technology Conference

You also want an ePaper? Increase the reach of your titles

Delete template?

Save as template?