MCX456A-FCAT - ConnectX-4 VPI adapter card, FDR IB (56Gb/s) and 40/56GbE, dual-port QSFP28

INFINIBAND

• 2 ports EDR / FDR / QDR / DDR / SDR
• IBTA Specification 1.3 compliant
• RDMA, Send/Receive semantics
• Hardware-based congestion control
• Atomic operations
• 16 million I/O channels
• 256 to 4Kbyte MTU, 2Gbyte messages
• 8 virtual lanes + VL15

ENHANCED FEATURES

• Hardware-based reliable transport
• Collective operations offloads
• Vector collective operations offloads
• Mellanox PeerDirectTM RDMA (aka GPUDirect®) communication acceleration
• 64/66 encoding
• Extended Reliable Connected transport (XRC)
• Dynamically Connected transport (DCT)
• Enhanced Atomic operations
• Advanced memory mapping support, allowing user mode registration and remapping of memory (UMR)
• On demand paging (ODP) –  registration free RDMA memory access

ETHERNET

• 100GbE / 56GbE / 50GbE / 40GbE / 25GbE / 10GbE / 1GbE
• IEEE 802.3bj, 802.3bm 100 Gigabit Ethernet
• 25G Ethernet Consortium 25, 50 Gigabit Ethernet
• IEEE 802.3ba 40 Gigabit Ethernet
• IEEE 802.3ae 10 Gigabit Ethernet
• IEEE 802.3az Energy Efficient Ethernet
• IEEE 802.3ap based auto-negotiation and KR startup
• Proprietary Ethernet protocols (20/40GBASE-R2, 50/56GBASE-R4)
• IEEE 802.3ad, 802.1AX Link Aggregation
• IEEE 802.1Q, 802.1P VLAN tags and priority IEEE 802.1Qau (QCN)
• Congestion Notification
• IEEE 802.1Qaz (ETS)
• IEEE 802.1Qbb (PFC)
• IEEE 802.1Qbg
• IEEE 1588v2
• Jumbo frame support (9.6KB)

STORAGE OFFLOADS

•  RAID offload - erasure coding (Reed-Solomon) offload
• T10 DIF - Signature handover operation at wire speed, for ingress and egress traffic

OVERLAY NETWORKS

• Stateless offloads for overlay networks and tunneling protocols
• Hardware offload of encapsulation and decapsulation of NVGRE and VXLAN overlay networks

HARDWARE-BASED I/O VIRTUALIZATION

• Single Root IOV
• Multi-function per port
• Address translation and protection
• Multiple queues per virtual machine
• Enhanced QoS for vNICs
• VMware NetQueue support

VIRTUALIZATION

• SR-IOV: Up to 256 Virtual Functions
• SR-IOV: Up to 16 Physical Functions per port
• Virtualization hierarchies (e.g. NPAR)
  • Virtualizing Physical Functions on a physical port)
  • SR-IOV on every Physical Function
• 1K ingress and egress QoS levels
• Guaranteed QoS for VMs

CPU OFFLOADS

• RDMA over Converged Ethernet (RoCE)
• TCP/UDP/IP stateless offload
• LSO, LRO, checksum offload
• RSS (can be done on encapsulated packet), TSS, HDS, VLAN insertion / stripping, Receive flow steering
• Intelligent interrupt coalescence

REMOTE BOOT

• Remote boot over InfiniBand
• Remote boot over Ethernet
• Remote boot over iSCSI
• PXE and UEFI

PROTOCOL SUPPORT

• OpenMPI, IBM PE, OSU MPI (MVAPICH/2), Intel MPI,
• Platform MPI, UPC, Mellanox SHMEM
• TCP/UDP, EoIB, IPoIB, SDP, RDS, MPLS, VxLAN, NVGRE, GENEVE
• SRP, iSER, NFS RDMA, SMB Direct
• uDAPL

MANAGEMENT AND CONTROL INTERFACES

• NC-SI, MCTP over SMBus and MCTP over PCIe - Baseboard Management Controller interface
• SDN management interface for managing the eSwitch
• I2C interface for device control and configuration
• General Purpose I/O pins
• SPI interface to Flash
• JTAG IEEE 1149.1 and IEEE 1149.61149.6