v200f - T-Platforms

V-CLASS FAMILY UPDATE
V5050 | V200S | V200SS | V200F2 | V200FS | V402S
JUNE 2014
Public presentation
VER 1 | ENG

AGENDA
• RECENT V-CLASS CHANGES
• T-PLATFORMS SYSTEMS’ PORTOFLIO
• V-CLASS POSITIONING
• V5050(L) ENCLOSURE
• INTEL XEON E5-2600 v2-BASED MODULES
• V402S SERVER MODULE (VLIW)
• V200 APPLICATION MATRIX
• MODULE PORTFOLIO MATRIX
• MANAGEMENT SUBSYSTEM
• SUMMARY
• BACKUP INFORMATION
2

RECENT V-CLASS CHANGES
• New V5050(L) enclosure
• V5000 and V5050L are at stock
• V5050 are built to order
• New server modules
• V200SS – Intel Xeon E5-2600 v2-based server with hot- and cold-swap
disks
• V200FS – Intel Xeon E5-2600 v2 ---based server with fixed, hot- and
cold-swap disks
• V402S – MCST Elbrus-based server with cold-swap disks
• AMD Opteron 6300-based modules are phased out
• V205S – built to large orders only
• V205F – discontinued
3

SYSTEMS’ PORTFOLIO
3 rd party board
T-MINI P (PRODUCTION):
• Minicluster/WS systems
• 4-8 DP compute trays
• 1 fixed head
• INTEL//NVIDIA
• Integrated storage
• Integrated networking
Workgroup
Shared T-Platforms V210 system board and
common management
E-CLASS (H2’14):
• 2U general
server/storage server
• 1 DP compute node
• V210 board (INTEL)
• HS disks
• Shares V-Class
management
V-CLASS (PRODUCTION):
• 5U air-cooled chassis
• 10 DP compute modules
• 5 accelerated DP
modules
• V2x0/V205/402 boards
INTEL/AMD/NVIDIA/ELBRUS
• Centralized management
Workgroup, Departmental and Divisional
A-CLASS (2014):
• ~52U cabinet
• Hot water cooling
• Integrated PSU blades
• Integrated blade
switches
• 1P INTEL+ NVIDIA GPU
@ launch
Rack level integration
Supercomputer
FAMILY ABBREVIATION SEGMENT
A-CLASS ADVANCED HIGH-END HPC
V-CLASS VOLUME MIDDLE-END HPC/HIGH END CLOUD/SMB
E-CLASS ENTERPRISE STORAGE OR GENERAL SERVER
T-MINI P (P-CLASS) PERSONAL SCALABLE ALL-IN ONE HPC/WS SYSTEMS
4

V-CLASS POSITIONING
• Scalable server family for
datacenters and internet
service providers:
• Heterogeneous HPC
• Remote visualization,
rendering desktop
virtualization
• Infrastructure and hosting
applications of service
providers
• Application servers
5

V5050(L) ENCLOSURE
• 5U chassis for 19″ racks with min depth of 1070mm
• Rear bays for 5-10 modules
• ‘Mix and match’ various servers
• Hot-plug support for cooling modules. PSUs and servers
• Integrated management module with Ethernet switch and iKVM
• LED control panel
• RS-485 interface to connect to the AESS (V5050)
• 2 GbE-порта управления шасси (V5050)
• RS-232 serial interface
• Up to 5 CRPS '80Plus Platinum‘ power supplies
• N+2, N+1 redundancy level support
• Up to 6.4kW of supplied power with N+1 redundancy
• 3 Highly Efficient N+1 cooling modules (2 coaxial fans each)
6

V5050(L) ENCLOSURE (2)
Cooling module
Enclosure front
• No cabled connections
• Mid-plane is a passive design with
mating connector
• Enclosure with PSUs – 38.35kg
Indication and control panel
Enclosure with no servers, rear view
• V200S:
• V200SS:
• V200F2:
• V200FS:
~ 4.9 kg (2 disks)
~ 6.8 kg (4 disks)
~ 8.7 kg (2 disks)
~ 13.1 kg (10 disks)
• The enclosure is supplied with fixed
rack-mount rails
CRPS Platinum
PSU
Management ports and
UID (V5050 version)
7

V5050L & V5050 DIFFERENCES
V5000 V5050L V5050
PSUs 4 x PSUs 5 x PSUs (CRPS)
Raiting Platinum Platinum (до 94%)
V5050L with 5 х V200FS
PSU
redundancy
Management
ports
N+1 N+1/N+2
1 x GbE 2 x GbE
AESS ports -- -- RS485
UID and error
code
reporting
-- -- Present
V5050 with 5 х V200FS
8

2-WAY INTEL XEON MODULES
• 4 passively cooled V200 modules
• V200S – compute module with cold-swap disks
• V200SS – server module with cold- and hot-swap disks
• V200F2 – double-width HPC/visualization module with 2 GPUs and coldswap
disks
• V200FS – double-width storage-enhanced server module
• Common feature set
• Up to two Intel Xeon E5-2600 v2 CPUs (TDP - 135W, except for V200SS
with 95W TDP)
• 16 slots for REG DDR3 DIMM, up to 1866 MHz
• 2 integrated GbE ports, optional 10/40GbE/FDR InfiniBand port
• 2 cold-swap 2.5” HDDa or SSDs (cable-free connection)
• Internal and external management interfaces
• ASPEED 2150 BMC
9

V200S MODULE
• Standard compute module,
supporting two 2.5” cold-swap disks
• Chipset-integrated SAS/SATA with
RAID 0/1
• 2 disks use 3Gbit/s SAS interface
• The best choice for high
performance compute clusters and
server farms with centralized storage
• Supports one low profile PCIe x16 Gen.3 adapter
• Fanless tray has no cabled connections inside
• A configuration of 10 х V200S reaches 4.3 Tflops of peak
performance
10

V200F2 MODULE
• Double-width compute module,
supporting two passively cooled
accelerators and two 2.5” cold-swap
disks
• Chipset-integrated SAS/SATA with RAID 0/1
• 2 disks use 3Gbit/s SAS interface
• Accelerators are supported through two PCIe
x16 Gen.3 slots equipped with riser cards
• NVIDIA Tesla K10, K20, K20X, K40
• NVIDIA GRID K1 & K2
• Intel Xeon® Phi 3120P, 5110P & 7120P
• Best suited for accelerated parallel computing, remote visualization and client
virtualization
• The HPC configuration of 5 х V200F2 reaches over 18 Tflops of peak
performance
11

THE NEW V200SS MODULE
• Standard server module, supporting
two 2.5” hot-swap disks and two 2.5”
cold-swap disks
• Chipset-integrated SAS/SATA with
RAID 0/1
• Hot-swap disks are using SATA 6 Gbit/s
• Cold-swap disks are using SAS 3 Gbit/s
• Positioned for broader range of server applications
• This module has a CPU thermal design power limit at 95W
• Fanless tray has cabled connections inside
12

THE NEW V200FS MODULE
• Double-width server module
supporting 4 hot-swap and 4
cold-swap 2.5” disks and 4
fixed 2.5” or 3.5” disks
• Chipset-integrated SAS/SATA
with RAID 0/1
• Supports a single 4- or 8-port
RAID adapter or HBA though
PCIe x16 Gen.3 slot
• Check out the V200FS online section for various storage
subsystem configuration options
• Total local storage space can reach 36TB
• Fanless tray has cabled connections inside
13

THE NEW V200FS MODULE (2)
14

THE NEW V402S MODULE
• Standard width server module featuring four
heterogeneous MCST Elbrus-2C+ CPUs (25W
TDP)
• Designed for customers interested in VLIW
architecture potential and for embedded
applications
• One module carries 8 core VLIW cores and 32
DSPs
• One PCIe x8 Gen.1.0a expansion slot
• Fanless cable-free tray
• Comes in 10 X V402S or mixed configurations
• Built to order
V402S
15

V200-SERIES APPLICATION MATRIX
APPLICATION TYPE
RATIN
G
HPC CLUSTER ***
RECOMMENDED
MODULES
V200S & V200F2 w
NVIDIA Tesla K/Intel
Xeon Phi
NOTES
WEB-SERVER (FRONT END) ** V200S/V200SS More expensive than 1U-server
WEB-SERVER (MIDDLE END) *** V200SS /V200FS
WEB-SERVER
(BACK END) ---
Low automation, insufficient availability, only 4 hot swap disks
out of 10 , low number of PCIe slots, unnecessary density
CLOUD APPS ** V200S/V200SS More expensive than 1U-servers and custom platforms
REMOTE VISUALIZATION ***
V200F2 w NVIDIA GRID
K1/K2
CItrix-ready (XenServer 6.2), NVIDIA GRID K-certified
TERMINAL SERVER *** V200S CItrix-ready (XenServer 6.2)
APPLICATION SERVER *** V200SS and V200FS
SMB-SERVER --- The system is too dense and costly
DATABASE SERVER * V200FS
VIRTUALIZATION ** V200S
Low automation, insufficient availability, only 4 hot swap disks
out of 10 , low number of PCIe slots, unnecessary density
No virtual server support by system’s management, actual
XenServer 6.2 certification, expecting VMWare certification
16

V-CLASS MODULE MATRIX
Model V200S V200F2 V200SS V200FS V402S V205S V205F
Module type Standard Double Standard Double Standard Standard Double
CPU 2 x Intel Xeon 2 x E5-2600 v2 4 x Elbrus 2С+ 2 х AMD Opteron 6300
Memory
16 х Reg DIMM DDR3, up to 1866MHz
8 х Reg
miniDIMM
DDR2
16 х Reg DIMM DDR3, up to
1600МГц
СS disks 2 2 2 2 2 2 2
HS disks - - 2 4 - - -
FX disks - - -
PCIe slots
1 x PCIe x16
Gen 3
2 x PCIe x16
Gen 3
-
4 (2.5” or
3.5”)
1 x PCIe x16
Gen 3
- - -
1 x PCIe x8
Gen 1
1 x PCIe x16 Gen 2
LP adapters 1 - 1 1 1 1 -
Accelerators
(FH FL)
- 2 - - - - 1 (M2090)
GbE ports Integrated 2 x GbE (Intel I350) Int., 1 x GbE Integrated, 2 x GbE
Integrated IB
port
10/40GbE or FDR InfiniBand ( 1 QSFP with optional SFP+
adapter)
10GbE/1 x QDR InfiniBand
(QSFP)
BMC
Integrated AST2150
miniDIMM with
AST2400
Integrated AST2050
CS – cold-swap
HS – hot-swap
FX – fixed
LP – low profile
FH FL – full size, full lenght
17

CONFIGURATION NOTES
Up to 10 V200S, V200SS or V402S
Up to 5 V200F2 or V200FS
Mixed configurations
Blank modules
• All spare bays have to host blank modules
to maintain correct airflow
18

SYSTEM’S MANAGEMENT (1)
SYSTEM’S MANAGEMENT CONTROLLER
Node control panel x 10
Fans and PSU status LEDs
Chassis power button
Chassis Front Section
• Indication and control module - 1U, cold-swappable
Serial/GbE ports to control all nodes
• Chassis and nodes management ports consolidation (one or two cables for 5-10 nodes)
• One independent GbE port on chassis front and two at the back (one is reserved for future use)
• Node indication, power and UID buttons | PSU and cooling modules status
Inside the Systems’ Management Module
• ARM-based minicomputer (SoC)
• Management switch with 11 internal 100Mbit/s ports
and three external GbE ports for node management
consolidation
• iKVM
19

SYSTEM’S MANAGEMENT(2)
V5050(L) features integrated web server with GUI(IMU) for in-band
and out-of-band system deployment and updating:
• Configuration detection
• Management network setup for SMC и modules’ BMC
• Pass-through access to modules’ BMC
• Monitoring (temp, tachs, power)
• Reset control
• FRU
• SEL
• Remote flashing
• Backup and firmware rollback
• Various access levels
20

SYSTEM’S MANAGEMENT (3)
Web-интерфейс IMU 1.2
21

SYSTEM’S MANAGEMENT(4)
Compute and server modules carry ASPEED AST2150 BMC (a
miniDIMM with AST2400 for the V402S) with integrated VGA и
two MACs
• Full IPMI 2.0 support, including KVM over LAN, Remote
Media, remote monitoring and management
• Secure WEB and CLI-based access
• Connection to compute module individual BMCs via systems
management controller or directly via GbE port 1
• Remote firmware update for BIOS and BMC
• No need for special utilities or pre-installed OS
miniDIMM with
BMC for V402S
22

SUMMARY
• Great variety of available compute and server modules (Intel, AMD,
MCST)
• High performance of Intel Xeon-based modules
• Up to 4.3 Tflops per system with 10 x V200S (TDP 135 W)
• Over 18 Tflops per system with 5 x V200F2 carrying 10 NVIDIA Tesla K40 GPUs
• Support for DDR3-1866MHz configurations
• Energy efficiency
• Optimized airflow
• Platinum power supplies
• Optimized cooling fans rotation algorithms
• Easy to deploy and manage
• Consolidated system management
• Intel ‘Haswell’ E5-2600 v3 modules are planned for H2’2014
23

THANK YOU!
t-platforms.com/v-class
sales@t-platforms.ru
24

BACKUP SLIDES
25

INTERNAL LAYOUT (V5000)
Compute modules with 2.5”
disks
Cooling modules
PSUs
Power distribution
board
Midplane
Control panel
Management controller

BLOCK CHART OF V5050L
27

BLOCK CHART OF V5050
28

V200 SYSTEM BOARD
4
5
7
3
2
8
9
7
6
6
1 1
6
6
10
11
12
Узлы V200S/F2
используют
унифицированную
системную плату
Системная плата V200-B2A
CPU’S
EXPANSION SLOTS AND PORTS
1. Socket 2011 for Intel Xeon E5-2600 v2 6. 16 DIMM DDR 3 slots
7. 2 PCIe x16 Gen.3 slots
INTEGRATED CONTROLLERS
8. 2 miniSAS: 4 SAS, 4 SATA
9 1 USB2.0 Type A port
2. Intel PCH C600 chipset
3. 1-port Mellanox ConnectX-3 chip (an option)
4. 2-port Intel I350 GbE controller
5. ASPEED 2150 BMC/VGA
SPECIALIZED INTERFACES
10. CardEdge (for identity card to interface with midplane)
11. CardEdge SAS 1 for one CS disk
12. CardEdge SAS 2 for one CS disk
29

ADDITIONAL IMAGES
Chassis rear
Management controller extraction Cooling modules Power supplies (V5000 version)
Chassis front
30

ADDITIONAL IMAGES (2)
V200F with 2 NVIDIA® Tesla GPUs
V200S
* Modules are shown without a top panel
31

ADDITIONAL IMAGES (3)
• V-Class-based HPC cluster
• Cold-door cabinet
• 7 x V5000 with V200S and
V200F2 modules
32

V-CLASS USE CASES
Stony Brook University, USA, 2012
CSC-IT for success, Finland, 2012
Juelich Research Centre, Germany, 2013
Over 25 projects in Russia, 2012-14
Подготовка стойки с
холодной дверью
для центра Юлих,
Германия
33