Skip to content
HN On Hacker News ↗

Axelera Titania Brings Native FP8 and FP4 to In-Memory Compute

▲ 48 points • 2 comments • by muxamilian • 6d ago • HN discussion ↗

Pangram verdict · v3.3

We believe that this text is a mix of AI and human-written content.

84 %

AI likelihood · overall

AI
16% human-written 84% AI-generated
SEGMENTS · HUMAN 0 of 2
SEGMENTS · AI 2 of 2
WORD COUNT 917
PEAK AI % 100% · §1
Analyzed
Nov 19
backend: pangram/v3.3
Segments scanned
2 windows
avg 459 words each
Distribution
16 / 84%
human / AI fraction
Verdict
AI
Pangram v3.3

Article text · 917 words · 2 segments analyzed

Human AI-generated
§1 AI · 100%

Analyst(s): Brendan Burke Publication Date: November 12, 2026 Axelera AI unveiled Titania, a chiplet that runs FP8 and FP4 math inside its digital in-memory compute arrays and wraps every matrix engine in RISC-V cores. Axelera says an 8-package, 4U air-cooled server delivers 20 PFLOPS of FP8 and 1 TB of LPDDR6 at about 6 kW with $300 million in commitments ahead of Q3 2027 production. What Is Covered in This Article: Titania chiplet, package, and AX8 reference server specs Third-generation D-IMC macro with native floating point RISC-V orchestration and vector cores inside every AI core LPDDR6 in place of HBM for MoE decode Air-cooled rack density against B200, MI355X, Intel GPU D270, and Qualcomm AI200 Futurum projections for HBM cost share and accelerator power The News: Axelera AI unveiled the architecture of Titania, its third-generation inference silicon, on November 12 ahead of SC26 in Chicago. Each Titania chiplet integrates 32 AI cores, 16 compute cores, and 128 MB of cluster-shared SRAM on TSMC N4C, for 1.25 PFLOPS of peak FP8 compute. Two chiplets connect over UCIe in a 400W system-in-package (SiP) with 2.5 PFLOPS of FP8, 16 LPDDR6 modules configurable from 128 GB to 2 TB, 2,458 GB/s of memory bandwidth, 1.28 TB/s of scale-up bandwidth, and a PCIe Gen6 x16 host link. The AX8 reference server places 8 SiPs in a 4U air-cooled chassis. Axelera says one AX8 server holds a 1.6 trillion parameter model at FP4 with room for KV cache, two fit in a legacy 15 kW rack, and five fit in a 30 kW air-cooled rack. The company projects up to 7x throughput per watt and up to 20x better TCO than the best data center servers available, based on its own simulations. Titania ships as PCIe cards and as OCP UBB baseboards with 8 OAM modules, in air-cooled and liquid-cooled versions through OEM partners. Production begins in Q3 2027 against more than $300 million in confirmed commitments, and the Titania PCIe card is a drop-in replacement for the Europa-based Axelera Server 250p. “We don’t ask anyone to trust a simulator,” said Evangelos Eleftheriou, CTO and co-founder of Axelera AI. “The architecture behind Titania already turns 88 percent of its memory bandwidth into tokens on Europa silicon that is shipping today.” Axelera Titania Brings Native FP8 and FP4 to In-Memory Compute Analyst Take: Axelera Titania is the first time Axelera’s digital in-memory compute (D-IMC) has done floating-point math, allowing an edge architecture to compete for frontier-scale inference. Europa, the shipping second generation, cast floating-point models into INT8 weights and INT16 activations. Titania’s third-generation macro computes MXFP4, FP4, MXFP8, FP8, and BF16 natively inside the SRAM arrays, which are the formats open-weight MoE models now ship in. RISC-V cores surround every array and make each AI core a programmable tile that can run a full network alone. Axelera wraps both in LPDDR6 and a power envelope that fits racks enterprises already own. Futurum views Titania as the most credible D-IMC design yet aimed at data center inference. The proof still sits in simulations of a chip that has not taped out, set against GPU data from September 2026 for a product that reaches volume in 2028. A Floating-Point Macro Moves Digital In-Memory Compute Into Frontier Model Formats In-memory compute has always promised to cut the energy spent shuttling weights between memory and arithmetic units and it has paid for that efficiency in numerical flexibility. Axelera’s first two generations ran integer math, casting floating-point values into INT8 weights and INT16 activations to cope with LLM outliers. The Titania macro is a complete redesign. Each AI core now delivers 39.3 TFLOPS of FP8 inside its D-IMC array, and 32 of them reach 1.25 PFLOPS per chiplet. The implication is that customers can run DeepSeek-R1, Qwen 3.5, and GPT-OSS checkpoints in the FP8 and MXFP4 formats their developers published, skipping the integer requantization step Europa required. d-Matrix, the other D-IMC vendor with data center cards in market, built Corsair around block-scaled integer formats. Axelera now claims native floating point across the format range GPU vendors support. Every throughput figure Axelera published for Titania depends on that macro behaving in silicon as it does in RTL-calibrated simulation. Source: Axelera AI RISC-V Turns the Matrix Engine Into a Programmable Inference Tile Axelera put RISC-V on the control path of every compute block in Titania. Each AI core pairs its D-IMC array with a RISC-V orchestration CPU that steers data paths, a RISC-V vector CPU with an 8,192-bit vector length, a streaming vector processor for activations, and 2 MB of local SRAM. The 16 compute cores each add 2 RISC-V CPUs with 4,096-bit vectors and 4 MB of shared SRAM to move data between accelerators and run video pre- and post-processing. A RISC-V application processor orchestrates the chiplet. By Futurum’s count of the published block diagram, that is roughly 97 RISC-V CPUs per chiplet. Futurum confirmed that the vector extension is Axelera’s proprietary design and that Titania uses no RISC-V matrix extension, since the D-IMC array performs matrix math. Vector lengths at that scale sit far beyond the 512-bit to 1,024-bit vectors common in licensed RISC-V AI cores such as SiFive’s Intelligence line. The software claim follows from the hardware. Axelera says its Voyager SDK reached compiler generality on Europa, compiling arbitrary PyTorch graphs through its AxeleraScript DSL, with vLLM and Kubernetes integrations that port to Titania unchanged.

§2 AI · 100%

“We don’t see any CUDA moat at all in inference,” said Manuel Botija, Vice President and Head of Product at Axelera AI.