HomeCXL CourseDay 9
DAY 9 · PHASE 2 — SPEC EVOLUTION

CXL 3.1 & 4.0
Fabric Scale-Out, Security & 128 GT/s

By EcrioniX · Updated July 2026

CXL 3.0 made the fabric possible. The two versions after it make it practical at scale and secure enough to trust. Day 9 covers both: CXL 3.1's routing and security refinements that let fabrics actually grow large, and CXL 4.0's leap to the PCIe 7.0 physical layer — the newest generation, released just at the end of 2025.

CXL 3.1 — Making the Fabric Scale and Secure

CXL 3.1 (2023) didn't change the wire speed — it stayed on the same PCIe 6.0 PHY at 64 GT/s as 3.0. Instead, it refined the fabric with two headline additions that address the two things holding CXL 3.0 back from large real-world deployment: how far it can scale, and whether it can be trusted with sensitive data.

CXL 3.1Port-Based Routing (PBR)

CXL 3.0 enabled non-tree topologies in principle, but its routing still had roots in the hierarchy-based (PCIe-tree-like) model. Port-Based Routing (PBR) replaces that: instead of routing by a rigid hierarchy, PBR routes by port, which is what actually enables much larger topologies and true any-to-any communication between nodes.

Why this matters: hierarchy-based routing scales the way a tree does — fine for modest sizes, but increasingly constraining as the fabric grows and you want arbitrary nodes to reach each other. PBR is the routing model that lets a CXL fabric span the kind of large, flexible, any-to-any topologies a rack-scale or multi-rack disaggregated-memory system actually needs. Note that PBR-capable switches were expected to arrive in 2026 or later — the spec preceded the silicon, as is common.

CXL 3.1TSP — Confidential Computing on CXL Memory

As CXL memory moves into shared, pooled, multi-tenant environments, a hard question arises: can a confidential workload trust memory that physically lives outside its own server? CXL TSP (Trusted-Execution-Environment Security Protocol) answers yes. It defines how to bring direct-attached CXL memory devices inside the trust boundary of a confidential VM (a TVM), so virtualization-based Trusted Execution Environments can host confidential computing workloads on CXL memory. TSP covers the full stack of what that requires:

🔑
Attestation & AuthProving a device is genuine and in a trusted state, via CMA/SPDM
🔒
Memory EncryptionProtecting the confidentiality of data held in CXL memory
🛠
Access ControlGoverning which entities may reach protected memory, plus dynamic capacity

Alongside PBR and TSP, CXL 3.1 also added memory-expander improvements including up to 32 bits of metadata and further RAS (reliability, availability, serviceability) enhancements — the unglamorous but essential robustness features large deployments demand.

CXL 4.0 — The Jump to PCIe 7.0

CXL 4.0 Released in December 2025, CXL 4.0 is the newest generation — and unlike 3.1, it does advance the physical layer, moving to the PCIe 7.0 PHY at 128 GT/s. That's double the 64 GT/s of the CXL 3.x line, addressing data centers facing ever-heavier AI, HPC, and memory-intensive workloads.

CXL 4.0 FeatureWhat It Delivers
PCIe 7.0 PHY, 128 GT/sDouble CXL 3.x bandwidth, with PCIe 7.0 FEC and CRC
Bundled PortsMultiple physical ports operate as one logical entity — higher aggregate throughput without added latency
Native x2 WidthAdds x2 link width to increase fan-out across more devices
Up to 4 RetimersExtends channel reach for large accelerators, multi-host fabrics, and pooling systems
Optical SupportEnables optical links for longer reach beyond copper limits
Latency-Optimized FlitSupports both the standard 256B flit and an additional 256B latency-optimized flit

CXL 4.0 details per the CXL Consortium 4.0 specification and December 2025 release materials.

Why Bundled Ports and Optical Matter

Two of these deserve emphasis. Bundled ports gang multiple physical links into one logical pipe — the way you feed a bandwidth-hungry accelerator that a single link can't satisfy, without paying a latency penalty for the aggregation. And optical support is the quiet enabler of real disaggregation: copper links are distance-limited, but optical links can stretch memory pooling across longer reaches — the physical foundation for the multi-rack memory fabrics that pooling and sharing have been building toward since Day 7.

The Full Version Ladder — Where We Are Now

VersionPCIe / SpeedDefining Addition
CXL 1.1 (2019)5.0 / 32 GT/sFoundation: expansion, coherent devices
CXL 2.0 (2022)5.0 / 32 GT/sSwitch, pooling, hot-plug, IDE
CXL 3.0 (2023)6.0 / 64 GT/sSharing, multi-level fabric, GFAM
CXL 3.1 (2023)6.0 / 64 GT/sPBR scale-out, TSP security
CXL 4.0 (Dec 2025)7.0 / 128 GT/sBandwidth doubling, bundled ports, optical

The arc of the whole spec history in one line: 1.1 proved coherent memory over PCIe works; 2.0 made it poolable; 3.0 made it shareable and fabric-shaped; 3.1 made that fabric scale and made it secure; 4.0 doubled the bandwidth and added the optical reach to stretch it across racks. Each version removed the specific limit the previous one left behind — which is exactly why understanding them in order (Days 6–9) makes CXL feel like a clean progression rather than a pile of features.

🎯 Day 9 Key Takeaways

Frequently Asked Questions

What is Port-Based Routing (PBR) in CXL 3.1?
Port-Based Routing (PBR) is a CXL 3.1 routing scheme that replaces hierarchy-based (PCIe-tree-like) routing. Because it routes by port rather than by a rigid hierarchy, PBR enables much larger topologies and any-to-any communication between nodes — the key to scaling CXL fabrics out beyond what tree-based routing allowed.
What is CXL TSP?
CXL TSP (Trusted-Execution-Environment Security Protocol) is a CXL 3.1 feature that lets virtualization-based Trusted Execution Environments (TEEs) host confidential computing workloads on CXL memory. It brings direct-attached CXL memory devices inside the confidential VM's trust boundary, covering attestation, memory encryption, transport security, access control, and dynamic capacity.
When was CXL 4.0 released and what physical layer does it use?
CXL 4.0 was released in December 2025. It uses the PCIe 7.0 physical layer at 128 GT/s — double the 64 GT/s of CXL 3.x — with PCIe 7.0's forward error correction and CRC, optical support, and up to four retimers for extending channel reach.
What are bundled ports in CXL 4.0?
Bundled ports are a CXL 4.0 capability that lets multiple physical ports operate as a single logical entity. This gives hosts and accelerators higher aggregate throughput without adding latency, effectively ganging several links together to feed bandwidth-hungry devices like large accelerators.
What is the latency-optimized flit in CXL 4.0?
CXL 4.0 supports both the standard 256-byte flit and an additional 256-byte latency-optimized flit. The latency-optimized variant is designed to reduce the latency overhead of the flit format for latency-sensitive traffic, complementing the higher raw bandwidth of the PCIe 7.0 physical layer.