ACCESS

XSEDE Resources

We have free access to many remote supercomputing systems through the XSEDE portal (eXtreme Science and Engineering Discovery Environment). Each year we get allocations through our campus champions account that users can access to supplement the local resources we have on Beocat. Many of these systems provide capabilities that Beocat does not, such as the 4 TB memory compute nodes on Bridges2, and the large number of 64-bit GPU nodes on many systems, as well as Matlab licenses. While we have some allocations to share, each user may also put in for a personal or group allocation for longer term access to greater resources. Below is a list of the supercomputers we have access to, their configurations, and the allocations we currently have on each.

Bridges2 at the Pittsburgh Supercomputing Center

488 RM regular Memory compute nodes allocated 37,266 SUs (core-hours)

• 2 x AMD EPYC 7742 --> 128 cores
• 256 GB memory (16 more nodes have 512 GB each)
• 3.84 TB NVMe SSD
• Mellanox HDR 200 Gbps network

4 EM Extreme Memory compute nodes allocated 8,068 SUs (core-hours)

• 4 x Intel Cascade 8260M --> 96 cores
• 4 TB memory
• 7.68 TB NVMe SSD
• Mellanox HDR 200 Gbps network

24 GPU compute nodes allocated 500 SUs (gpu-hours)

• 2 x Intel Gold Cascade 6248 --> 40 cores
• 8 x nVidia Tesla v100 32 GB sxm2 GPU cards
• 512 GB memory
• 7.68 TB NVMe SSD
• Mellanox HDR 200 Gbps network

Expanse at San Diego Supercomputing Center

This system is still coming on line, so we don't have any allocations on it yet.

728 compute nodes

• 2 x AMD EPYC 7742 --> 128 cores
• 256 GB memory

4 Large Memory nodes

• 4 x Intel Cascade 8260M --> 96 cores
• 2 TB memory

54 GPU nodes

• 2 x Intel Xeon 6248 --> 40 cores
• 4 x nVidia Tesla v100 GPU cards
• 384 GB memory

Cluster-wide capabilities

• 12 PetaByte Lustre file system
• 7 PetaByte CEPH object store
• 56 Gbps bi-directional HDR InfiniBand network