Keyboard shortcuts

Press ← or → to navigate between chapters

Press S or / to search in the book

Press ? to show this help

Press Esc to hide this help

Cluster GPU Layout

The cluster has 14 nodes and 78 GPUs in total that are available at the moment.

GPU ModelCount
NVIDIA H200 NVL (140.4 GB)31
NVIDIA L40S (45.0 GB)13
NVIDIA RTX 6000 Ada Generation (45.0 GB)8
NVIDIA RTX 6000 Ada Generation (48.0 GB)13
NVIDIA RTX A6000 (48.0 GB)2
NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition (95.6 GB)4
NVIDIA RTX PRO 6000 Blackwell Server Edition (95.6 GB)7

watgpu108

IndexModelMemory
0NVIDIA RTX 6000 Ada Generation45.0 GB
1NVIDIA RTX 6000 Ada Generation45.0 GB
2NVIDIA RTX 6000 Ada Generation45.0 GB
3NVIDIA RTX 6000 Ada Generation45.0 GB
4NVIDIA RTX 6000 Ada Generation45.0 GB
5NVIDIA RTX 6000 Ada Generation45.0 GB
6NVIDIA RTX 6000 Ada Generation45.0 GB
7NVIDIA RTX 6000 Ada Generation45.0 GB

watgpu208

IndexModelMemory
0NVIDIA RTX 6000 Ada Generation48.0 GB
1NVIDIA RTX 6000 Ada Generation48.0 GB
2NVIDIA RTX 6000 Ada Generation48.0 GB
3NVIDIA RTX 6000 Ada Generation48.0 GB
4NVIDIA RTX 6000 Ada Generation48.0 GB
5NVIDIA RTX 6000 Ada Generation48.0 GB
6NVIDIA RTX 6000 Ada Generation48.0 GB

watgpu308

IndexModelMemory
0NVIDIA L40S45.0 GB
1NVIDIA L40S45.0 GB
2NVIDIA L40S45.0 GB
3NVIDIA L40S45.0 GB
4NVIDIA RTX A600048.0 GB
5NVIDIA RTX A600048.0 GB
6NVIDIA RTX 6000 Ada Generation48.0 GB
7NVIDIA RTX 6000 Ada Generation48.0 GB

watgpu408

IndexModelMemory
0NVIDIA L40S45.0 GB
1NVIDIA L40S45.0 GB
2NVIDIA L40S45.0 GB
3NVIDIA L40S45.0 GB
4NVIDIA L40S45.0 GB
5NVIDIA L40S45.0 GB
6NVIDIA L40S45.0 GB

watgpu508

IndexModelMemory
0NVIDIA H200 NVL140.4 GB
1NVIDIA H200 NVL140.4 GB
2NVIDIA H200 NVL140.4 GB
3NVIDIA H200 NVL140.4 GB
4NVIDIA H200 NVL140.4 GB
5NVIDIA H200 NVL140.4 GB
6NVIDIA H200 NVL140.4 GB

watgpu608

IndexModelMemory
0NVIDIA L40S45.0 GB
1NVIDIA L40S45.0 GB
2NVIDIA RTX 6000 Ada Generation48.0 GB
3NVIDIA RTX 6000 Ada Generation48.0 GB
4NVIDIA RTX 6000 Ada Generation48.0 GB
5NVIDIA RTX 6000 Ada Generation48.0 GB

watgpu708

IndexModelMemory
0NVIDIA H200 NVL140.4 GB
1NVIDIA H200 NVL140.4 GB
2NVIDIA H200 NVL140.4 GB
3NVIDIA H200 NVL140.4 GB

watgpu808

IndexModelMemory
0NVIDIA H200 NVL140.4 GB
1NVIDIA H200 NVL140.4 GB

watgpu908

IndexModelMemory
0NVIDIA H200 NVL140.4 GB
1NVIDIA H200 NVL140.4 GB
2NVIDIA H200 NVL140.4 GB
3NVIDIA H200 NVL140.4 GB
4NVIDIA H200 NVL140.4 GB
5NVIDIA H200 NVL140.4 GB

watgpu1008

IndexModelMemory
0NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition95.6 GB
1NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition95.6 GB
2NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition95.6 GB
3NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition95.6 GB
4NVIDIA RTX PRO 6000 Blackwell Server Edition95.6 GB
5NVIDIA RTX PRO 6000 Blackwell Server Edition95.6 GB

watgpu1103

IndexModelMemory
0NVIDIA H200 NVL140.4 GB
1NVIDIA H200 NVL140.4 GB
2NVIDIA H200 NVL140.4 GB
3NVIDIA H200 NVL140.4 GB

watgpu1109

IndexModelMemory
0NVIDIA RTX PRO 6000 Blackwell Server Edition95.6 GB
1NVIDIA RTX PRO 6000 Blackwell Server Edition95.6 GB
2NVIDIA RTX PRO 6000 Blackwell Server Edition95.6 GB
3NVIDIA RTX PRO 6000 Blackwell Server Edition95.6 GB
4NVIDIA RTX PRO 6000 Blackwell Server Edition95.6 GB

watgpu1208

IndexModelMemory
0NVIDIA H200 NVL140.4 GB
1NVIDIA H200 NVL140.4 GB
2NVIDIA H200 NVL140.4 GB
3NVIDIA H200 NVL140.4 GB

watgpu1209

IndexModelMemory
0NVIDIA H200 NVL140.4 GB
1NVIDIA H200 NVL140.4 GB
2NVIDIA H200 NVL140.4 GB
3NVIDIA H200 NVL140.4 GB