NVMe over TCP

Optimizing Next-Gen Infrastructure for High-Performance Data Needs

Lightbits Labs invented NVMe® over TCP, the protocol of the future for high-performance data access on low latency networking. NVMe/TCP is typically implemented to modernize legacy SANs, iSCSI, and Fiber Channel though it’s specifically adapted for NVMe-based storage performance.

EE Times described NVMe/TCP as a means to address the “data tsunami” from AI and IoT by allowing tens of thousands of NVMe drives to appear local to hosts over Ethernet.

Ubiquitous standard for storage disaggregation

NVMe over TCP, often written NVMe/TCP, is a network transport protocol within the NVMe-oF specification. It extends the NVMe standard over TCP networks. This enables the transmission of NVMe-oF commands over standard Ethernet-based TCP/IP networks, providing scalable and efficient access to NVMe storage devices without the need for specialized hardware or networking interfaces. It is a component of the broader NVMe-oF standard.

It was designed for high-performance direct-attached PCIe SSDs and was later expanded with NVMe over Fabrics (NVMe-oF™) to support a hyperscale remote pool of SSDs. The industry has widely accepted that this new NVMe-oF model will replace Direct-Attached Storage (DAS) and become the default protocol for disaggregated storage in cloud infrastructure.

Parallelism of NVMe over TCP

Disaggregation for tens of thousands of nodes across entire data center

First flexible connection setup ideal for containers and serverless cloud-native applications

Maximized SSD utilization in the data center

Disaggregated storage with the performance and latency of direct-attached SSDs

Parallelism of NVMe over TCP

Built on top of the TCP/IP software stack, NVMe®/TCP enables efficient and streamlined block storage, optimized for today’s multi-core application servers.

Server Parallelism

Multi- Core CPUs and Multiple NVMe I/O Queues

Network Parallelism

Multiple NVMe I/O Queues mapped to Multiple TCP connections

Lightbits Parallelism

Lightbits NVMe/TCP Open Storage Platform