[Gems-users] 64 core simulation problems and torus configuration in Garnet

[안정섭 <jeong.seob.ahn@xxxxxxxxx>]

Dear all users

 

1. 64 core simulation problems

Serengeti model does not support 64 core system officially. I read the article that https://www.simics.net/mwf/topic_show.pl?pid=41190&hl=cluster%2064&hlm=and#41190 and then I prepare "serengeti-6800-cluster-system"

 

When i simulate 64 core system, I meet the run-time error.

Runtime Error at ../protocols/MOESI_SMP_token-cache.sm:759, Ruby Time: 182085087: assert failure, PID: 18899

 

why this situation occurs? any other patch is needed?

When i simulate 16 core system, this situation does not occur. It works well.

 

2. TORUS configuration in Garnet

 

Another question is TORUS configuration in Garnet

I compared MESH with TORUS topology. I think that run-time of TORUS will be better than MESH but, TORUS does not acutally better than MESH in any kinds of workloads such as (water-sp, raytrace and etc).

 

Can this situation happen?

 

This is a my torus network configuration file. 

--------------------------------------------------------------------------- 

ext_node:L1Cache:0 int_node:0 link_latency:1
ext_node:L1Cache:1 int_node:1 link_latency:1
ext_node:L1Cache:2 int_node:2 link_latency:1
ext_node:L1Cache:3 int_node:3 link_latency:1
ext_node:L1Cache:4 int_node:4 link_latency:1
ext_node:L1Cache:5 int_node:5 link_latency:1
ext_node:L1Cache:6 int_node:6 link_latency:1
ext_node:L1Cache:7 int_node:7 link_latency:1
ext_node:L1Cache:8 int_node:8 link_latency:1
ext_node:L1Cache:9 int_node:9 link_latency:1
ext_node:L1Cache:10 int_node:10 link_latency:1
ext_node:L1Cache:11 int_node:11 link_latency:1
ext_node:L1Cache:12 int_node:12 link_latency:1
ext_node:L1Cache:13 int_node:13 link_latency:1
ext_node:L1Cache:14 int_node:14 link_latency:1
ext_node:L1Cache:15 int_node:15 link_latency:1

ext_node:Directory:0 int_node:0 link_latency:20 
ext_node:Directory:1 int_node:1 link_latency:20 
ext_node:Directory:2 int_node:2 link_latency:20 
ext_node:Directory:3 int_node:3 link_latency:20 
ext_node:Directory:4 int_node:4 link_latency:20 
ext_node:Directory:5 int_node:5 link_latency:20
ext_node:Directory:6 int_node:6 link_latency:20
ext_node:Directory:7 int_node:7 link_latency:20
ext_node:Directory:8 int_node:8 link_latency:20
ext_node:Directory:9 int_node:9 link_latency:20
ext_node:Directory:10 int_node:10 link_latency:20
ext_node:Directory:11 int_node:11 link_latency:20
ext_node:Directory:12 int_node:12 link_latency:20
ext_node:Directory:13 int_node:13 link_latency:20
ext_node:Directory:14 int_node:14 link_latency:20
ext_node:Directory:15 int_node:15 link_latency:20

int_node:0 int_node:1 link_latency:1 link_weight:1
int_node:1 int_node:2 link_latency:1 link_weight:1
int_node:2 int_node:3 link_latency:1 link_weight:1

int_node:4 int_node:5 link_latency:1 link_weight:1
int_node:5 int_node:6 link_latency:1 link_weight:1
int_node:6 int_node:7 link_latency:1 link_weight:1

int_node:8 int_node:9 link_latency:1 link_weight:1
int_node:9 int_node:10 link_latency:1 link_weight:1
int_node:10 int_node:11 link_latency:1 link_weight:1

int_node:12 int_node:13 link_latency:1 link_weight:1
int_node:13 int_node:14 link_latency:1 link_weight:1
int_node:14 int_node:15 link_latency:1 link_weight:1

int_node:0 int_node:4 link_latency:1 link_weight:2
int_node:4 int_node:8 link_latency:1 link_weight:2
int_node:8 int_node:12 link_latency:1 link_weight:2

int_node:1 int_node:5 link_latency:1 link_weight:2
int_node:5 int_node:9 link_latency:1 link_weight:2
int_node:9 int_node:13 link_latency:1 link_weight:2

int_node:2 int_node:6 link_latency:1 link_weight:2
int_node:6 int_node:10 link_latency:1 link_weight:2

 ----------------------------------------------------------------------------

 

Also, mesh-network configuration file like above except for last 8 lines

 

Best regards.

Jeongseob Ahn