Technical Specifications

The following are technical specifications for Pitzer.  

  Pitzer SYSTEM (2018) Pitzer SYSTEM (2020)
NUMBER OF NODES 260 nodes 398 nodes
NUMBER OF CPU SOCKETS 528 (2 sockets/node for standard node) 796 (2 sockets/node for all nodes)
NUMBER OF CPU CORES 10,560 (40 cores/node for standard node) 19,104 (48 cores/node for all nodes)
CORES PER NODE 40 cores/node (80 cores/node for Huge Mem Nodes) 48 cores/node for all nodes
LOCAL DISK SPACE PER NODE

850 GB in /tmp

1 TB for most nodes

4 TB for quad GPU

0.5 TB for large mem

 

COMPUTE CPU SPECIFICATIONS

Intel Xeon Gold 6148 (Skylake) for compute

  • 2.4 GHz 
  • 20 cores per processor

Intel Xeon 8268s Cascade Lakes for most compute

  • 2.9 GHz
  • 24 cores per processor
COMPUTER SERVER SPECIFICATIONS

224 Dell PowerEdge C6420

32 Dell PowerEdge R740 (for accelerator nodes)

4 Dell PowerEdge R940

352 Dell PowerEdge C6420

42 Dell PowerEdge R740 (for dual GPU nodes)

4 Dell Poweredge c4140 (for quad GPU nodes)

 

ACCELERATOR SPECIFICATIONS

NVIDIA V100 "Volta" GPUs 16GB memory

NVIDIA V100 "Volta" GPUs 32GB memory for dual GPU

NVIDIA V100 "Volta" GPUs 32GB memory and NVLink for quad GPU

NUMBER OF ACCELERATOR NODES

32 total (2 GPUs per node)

42 dual GPU nodes (2 GPUs per node)

4 quad GPU nodes (4 GPUs per node)

TOTAL MEMORY ~ 67 TB ~ 95 TB
MEMORY PER NODE

192 GB for standard nodes

384 GB for accelerator nodes

3 TB for Huge Mem Nodes

192 GB for standard nodes

384 GB for dual GPU nodes

768 GB for quad and Large Mem Nodes

MEMORY PER CORE

4.8 GB for standard nodes

9.6 GB for accelerator nodes

76.8 GB for Huge Mem

4.0 GB for standard nodes

8.0 GB for dual GPU nodes

16.0 GB for quad and Large Mem Nodes

INTERCONNECT  Mellanox EDR Infiniband Networking (100Gbps) Mellanox EDR Infiniband Networking (100Gbps)
LOGIN SPECIFICATIONS

4 Intel Xeon Gold 6148 (Skylake) CPUs

  • 40 cores/node and 384 GB of memory/node
SPECIAL NODES

4 Huge Memory Nodes

  • Dell PowerEdge R940 
  • 4 Intel Xeon Gold 6148 (Skylake)
    • 20 Cores
    • 2.4 GHz
  • 80 cores (20 cores/CPU)
  • 3 TB Memory
  • 2x Mirror 1 TB Drive (1 TB usable)
4 quad GPU Nodes 
  • Dual Intel Xeon 8260s Cascade Lakes
  • Quad NVIDIA Volta V100s w/32GB GPU memory and NVLink
  • 48 cores per node @ 2.4GHz
  • 768GB memory
  • 4 TB disk space

12 Large Memory Nodes

  • Dual Intel Xeon 8268 Cascade Lakes
  • 48 cores per node @ 2.9GHz
  • 768GB memory
  • 0.5 TB disk space
Supercomputer: