Pratyush is India’s fastest supercomputer yet (Jan 2018) with 4+ Petaflops of peak performance powered by Intel Xeon Broadwell E5-2695 v4 CPU and has total storage of 27 Petabytes. It has Intel KNL 7210 nodes with a peak performance of 42+ TFLOPS .
System Configuration Details
-
Hardware
Cray XC40 System System Configuration
Cray XC40 Compute Cabinets 18
Interconnect Network Cray Aries with Dragonfly topology
Total Peak Performance 4,006 TFLOPS
-
Compute NodeNumber of Nodes 3,315
Processor Intel Xeon Broadwell E5-2695 v4 CPU (18 core, 2.1 GHz)
Memory Per Node 128 GiB Memory DDR4-2400 w/ Chipkill TM technology
Total Memory 414 TiB
-
Accelerator NodeNumber of Nodes 16
Accelerator Intel KNL 7210, self-hosted mode, single socket per node
Memory Per Node 96 GiB DDR4-2133 w/ Chipkill TM technology
Total Peak Performance 42.56 TFLOPS
-
Additional NodesExternal Login Nodes 5
Utility Servers 8
Utility Racks 1
-
Storage System ConfigurationParallel File System Lustre
IOPS per File System – Home and Scratch 50,000+
Lnet Nodes 39
Storage Array (For Home and Scratch) Sonexion 3000
Storage Racks 5 racks + 6 Tape library frames
-
PFS – HomeUseable Storage 8.6 PB @ 264 GiB/s Write 231 GiB/s Read
Sonexion Config One MMU + 26 SSU
Lustre I/O Nodes (Embedded) 2 MDS + 52 OSS (Active/Active config)
HDD Data 6 TB – 7.2K RPM on GridRAID (RAID 6)
HDD Metadata 900 GB – 10K RPM on RAID 10
Number of Files per MMU 4B+
-
PFS – ScratchUseable Storage 1.1 PB @ 50.69 GiB/s Write 53.21 GiB/s Read
Sonexion Config One MMU + 4 SSU
Lustre I/O Nodes (Embedded) 2 MDS + 8 OSS (Active/Active config)
HDD Data 4 TB – 10K RPM on GridRAID (RAID 6)
HDD Metadata 900 GB – 10K RPM on RAID 10
Number of Files per MMU 4B+
-
HSM / Archive TierArchive Useable 27.4 PB
Storage Array Disk Cache for HSM NetApp E5600 series (273 TB)
HSM Servers 2 Metadata controllers + 2 Connection Managers+ 4 connector agents +2 External gateways
Tape Library SpectraLogic TFinity
Number of drives LTO-7 48
Media LTO-7 Qty/Slots 5190
HSM Solution Versity VSM 1.0
-
Software StackCray Linux Environment 6.x
Cray Programming Environment (CPE) 10 Seats
Intel Parallel Studio XE Professional Edition 7 Seats
Workload Manager PBS Pro 13.0
Additional/Optional debugger 2048 core
PV-View License 1
