Daveturner (talk | contribs) |
Daveturner (talk | contribs) |
||
| Line 25: | Line 25: | ||
projects | projects | ||
change_primary_group [account_ID] | change_primary_group [account_ID] | ||
or within your job script | |||
-A [account_ID] | -A [account_ID] | ||
| Line 41: | Line 41: | ||
=== Bridges2 at the Pittsburgh Supercomputing Center === | === Bridges2 at the Pittsburgh Supercomputing Center === | ||
'''488 RM regular Memory compute nodes''' | |||
'''488 RM regular Memory compute nodes''' | |||
* 2 x AMD EPYC 7742 --> 128 cores | * 2 x AMD EPYC 7742 --> 128 cores | ||
* 256 GB memory (16 more nodes have 512 GB each) | * 256 GB memory (16 more nodes have 512 GB each) | ||
| Line 50: | Line 47: | ||
* Mellanox HDR 200 Gbps network | * Mellanox HDR 200 Gbps network | ||
'''4 EM Extreme Memory compute nodes''' | '''4 EM Extreme Memory compute nodes''' | ||
* 4 x Intel Cascade 8260M --> 96 cores | * 4 x Intel Cascade 8260M --> 96 cores | ||
* 4 TB memory | * 4 TB memory | ||
| Line 56: | Line 53: | ||
* Mellanox HDR 200 Gbps network | * Mellanox HDR 200 Gbps network | ||
'''24 GPU compute nodes''' | '''24 GPU compute nodes''' | ||
* 2 x Intel Gold Cascade 6248 --> 40 cores | * 2 x Intel Gold Cascade 6248 --> 40 cores | ||
* 8 x nVidia Tesla v100 32 GB sxm2 GPU cards | * 8 x nVidia Tesla v100 32 GB sxm2 GPU cards | ||
| Line 66: | Line 63: | ||
All nodes are shared so you request the cores you need, not whole nodes. | All nodes are shared so you request the cores you need, not whole nodes. | ||
'''728 compute nodes''' | '''728 compute nodes''' | ||
Latest revision as of 13:58, 4 November 2026
Remote Resources through the ACCESS Program
We have free access to many remote supercomputing systems through the ACCESS program. Each year we get allocations through our Campus Champions account that users can access to supplement the local resources we have on Beocat. Many of these systems provide capabilities that Beocat does not, such as the 4 TB memory compute nodes on Bridges2, and the large number of more powerful GPU nodes on many systems, as well as Matlab licenses. While we have some allocations to share, each user may also put in for a personal or group allocation for longer term access to greater resources.
Below is a list of some of the systems we have access to, their configurations. Each of these systems is similar to Beocat in that they run the Linux operating system and Slurm scheduler and have a similar module system. To get access to these resources, create an account at the ACCESS website http://access-ci.org/ then contact Dr. Dave Turner.
For users that have access to multiple accounts, you can get a listing of the account string and set your default account using the commands below, or you can set your account in each job script.
projects
change_primary_group [account_ID]
or within your job script
-A [account_ID]
NCSA Delta GPU
- NVIDIA A100 - 40 GB
- NVIDIA H200 - 141 GB
NCSA DeltaAI
- GH200 - ARM 72 cores 120 GB RAM H100 with 96 GB
Purdue Anvil
- NVIDIA A100 - 40 GB
- NVIDIA H100 - 80 GB
Bridges2 at the Pittsburgh Supercomputing Center
488 RM regular Memory compute nodes
- 2 x AMD EPYC 7742 --> 128 cores
- 256 GB memory (16 more nodes have 512 GB each)
- 3.84 TB NVMe SSD
- Mellanox HDR 200 Gbps network
4 EM Extreme Memory compute nodes
- 4 x Intel Cascade 8260M --> 96 cores
- 4 TB memory
- 7.68 TB NVMe SSD
- Mellanox HDR 200 Gbps network
24 GPU compute nodes
- 2 x Intel Gold Cascade 6248 --> 40 cores
- 8 x nVidia Tesla v100 32 GB sxm2 GPU cards
- 512 GB memory
- 7.68 TB NVMe SSD
- Mellanox HDR 200 Gbps network
Expanse at San Diego Supercomputing Center
All nodes are shared so you request the cores you need, not whole nodes.
728 compute nodes
- 2 x AMD EPYC 7742 --> 128 cores
- 256 GB memory
4 Large Memory nodes
- 4 x Intel Cascade 8260M --> 96 cores
- 2 TB memory
52 GPU nodes
- 2 x Intel Xeon 6248 --> 40 cores
- 4 x nVidia Tesla v100 GPU cards
- 384 GB memory
Cluster-wide capabilities
- 12 PetaByte Lustre file system
- 7 PetaByte CEPH object store
- 56 Gbps bi-directional HDR InfiniBand network
Frontera at TACC
We have access to Frontera which is currently the 10th fastest supercomputer in the world. Our allocation is 2,000 node-hours on the regular compute nodes, and 500 node-hours on the GPU nodes.
8,368 compute nodes
- 2 x Intel Xeon Platinum 8280 --> 56 cores
- 192 GB memory
16 Large Memory nodes
- 4 x Intel Xeon Platinum 8280 --> 112 cores
- 2.1 TB Optane memory
90 GPU nodes
- 2 x Intel Xeon 6248 --> 40 cores
- 4 x nVidia Quadro RTX 5000 GPUs
- 128 GB memory