MCX556A-EDAT - ConnectX-5 Ex VPI adapter card, EDR IB (100Gb/s) and 100GbE, dual-port QSFP28

INFINIBAND

• EDR / FDR / QDR / DDR / SDR
• IBTA Specification 1.3 compliant
• RDMA, Send/Receive semantics
• Hardware-based congestion control
• Atomic operations
• 16 million I/O channels
• 256 to 4Kbyte MTU, 2Gbyte messages
• 8 virtual lanes + VL15

ETHERNET

• 100GbE / 50GbE / 40GbE / 25GbE / 10GbE / 1GbE
• IEEE 802.3bj, 802.3bm 100 Gigabit Ethernet
• IEEE 802.3by, Ethernet Consortium 25, 50 Gigabit Ethernet, supporting all FEC modes
• IEEE 802.3ba 40 Gigabit Ethernet
• IEEE 802.3ae 10 Gigabit Ethernet
• IEEE 802.3az Energy Efficient Ethernet
• IEEE 802.3ap based auto-negotiation and KR startup
• Proprietary Ethernet protocols (20/40GBASE-R2, 50/56GBASE-R4)
• IEEE 802.3ad, 802.1AX Link Aggregation
• IEEE 802.1Q, 802.1P VLAN tags and priority
• IEEE 802.1Qau (QCN)
• Congestion Notification
• IEEE 802.1Qaz (ETS)
• IEEE 802.1Qbb (PFC)
• IEEE 802.1Qbg
• IEEE 1588v2
• Jumbo frame support (9.6KB)

ENHANCED FEATURES

• Hardware-based reliable transport
• Collective operations offloads
• Vector collective operations offloads
• PeerDirect™ RDMA (aka GPUDirect®) communication acceleration
• 64/66 encoding
• Extended Reliable Connected transport (XRC)
• Dynamically Connected transport (DCT)
• Enhanced Atomic operations
• Advanced memory mapping support, allowing user mode registration and remapping of memory (UMR)
• On demand paging (ODP)
• MPI Tag Matching
• Rendezvous protocol offload
• Out-of-order RDMA supporting Adaptive Routing
• Burst buffer offload
• In-Network Memory registration-free RDMA memory access

CPU OFFLOADS

• RDMA over Converged Ethernet (RoCE)
• TCP/UDP/IP stateless offload
• LSO, LRO, checksum offload
• RSS (also on encapsulated packet), TSS, HDS, VLAN and MPLS tag insertion / stripping, Receive flow steering
• Data Plane Development Kit (DPDK) for kernel bypass applications
• Open VSwitch (OVS) offload using ASAP2
  • Flexible match-action flow tables
  • Tunneling encapsulation / de-capsulation
• Intelligent interrupt coalescence
• Header rewrite supporting hardware offload of NAT router

STORAGE OFFLOADS

• NVMe over Fabric offloads for target machine
• Erasure Coding offload - offloading Reed Solomon calculations
• T10 DIF - Signature handover operation at wire speed, for ingress and egress traffic
• Storage Protocols:
  • SRP, iSER, NFS RDMA, SMB Direct, NVMf

OVERLAY NETWORKS

• RoCE over Overlay Networks
• Stateless offloads for overlay network tunneling protocols
• Hardware offload of encapsulation and decapsulation of VXLAN, NVGRE, and GENEVE overlay networks

HARDWARE-BASED I/O VIRTUALIZATION

• Single Root IOV
• Address translation and protection
• VMware NetQueue support
• SR-IOV: Up to 512 Virtual Functions
• SR-IOV: Up to 16 Physical Functions per host
• Virtualization hierarchies (e.g., NPAR and MultiHost, when enabled)
  • Virtualizing Physical Functions on a physical port
  • SR-IOV on every Physical Function
• Configurable and user-programmable QoS
• Guaranteed QoS for VMs

HPC SOFTWARE LIBRARIES

• Open MPI, IBM PE, OSU MPI (MVAPICH/2), Intel MPI
• Platform MPI, UPC, Open SHMEM

MANAGEMENT AND CONTROL

• NC-SI over MCTP over SMBus and NC-SI over MCTP over PCIe - Baseboard Management Controller interface
• SDN management interface for managing the eSwitch
• I 2 C interface for device control and configuration
• General Purpose I/O pins
• SPI interface to Flash
• JTAG IEEE 1149.1 and IEEE 1149.6

REMOTE BOOT

• Remote boot over InfiniBand
• Remote boot over Ethernet
• Remote boot over iSCSI
• Unified Extensible Firmware Interface (UEFI)
• Pre-execution Environment (PXE)