[关闭]
@HaomingJiang 2017-11-11T12:06:58.000000Z 字数 1530 阅读 1143

CSE6230 Final Project Checkpoint #2

Haoming Jiang, Wenjie Yao


Computing Platform

Bridges, K80 (1--4) or P100 (1--2)

Pseudocode

Denote the position of each entry of the cude with a turple . Bascially we want to rearrange the computing order for entries, so that we can divide all entries into different successive parts where the entries in the same part can be computed in parallel.

Observation1 : Note that for certain , any two are not directly related, which means they can be computed in parallel.
Observation2 : For any stripe , it only depends on its 8 neighbor stripes.

Based on the above Observation2, we can derive the following coloring method where entries for the same color can be computed in parallel:
1. i%2==0 && j%2==0, color=0
2. i%2==0 && j%2==1, color=1
3. i%2==1 && j%2==0, color=2
4. i%2==1 && j%2==1, color=3

We evenly divide s for the same color into parts, where is the total number of blocks in GPU computing.

  1. // Pseudocode
  2. block_id = get_block_id();
  3. thread_id = get_thread_id();
  4. for(i = 1:max_iterations)
  5. for( color_id = 0:3 )
  6. {
  7. for( (i,j) in ijpairs[color_id][get_block_id] )
  8. for( k = (n*thread_id)/thread_num:(n*thread_id+n)/thread_num-1 )
  9. update(i,j,k);
  10. synchronize(); // or barrier()
  11. }

Machine characteristics

K80:
Number of cores: 4992
Total Memory Bandwidth: 480 GB/s
Memory: 24 GB GDDR5
Double-precision Performance: 2.91 Teraflops
Single-precision Performance: 8.73 Teraflops
P100:
Number of cores: 3584
Total Memory Bandwidth: 732 GB/s
Memory: 16 GB GDDR5
Double-precision Performance: 4.7 Teraflops
Single-precision Performance: 9.3 Teraflops

PCIe x16 Interconnect Bandwidth(K80,P100): 32 GB/s
NVIDIA NVLink™ Interconnect Bandwidth(P100): 160 GB/s

Asymptotic Analysis

Bottleneck Analysis

添加新批注
在作者公开此批注前,只有你和作者可见。
回复批注