Meta has laid out an aggressive, inference-first roadmap for its in-house accelerators, announcing four Meta Training and Inference Accelerator (MTIA) generations developed with Broadcom and due to be integrated into its data centers over the next two years. The family spans MTIA 300, 400, 450, and 500, with early units already running ranking and recommendation workloads and later designs optimized for real-time model serving. Since Meta runs some of the largest social platforms on the web, developing a fast inference accelerator is required to make social media browsing and recommendation algorithms instant. Rather than pursuing raw peak arithmetic alone, Meta emphasizes memory throughput and inference efficiency. According to the specification table, HBM bandwidth and capacity rises substantially across the series while compute grows more linearly. This means that Meta's point is increasing on-package bandwidth and capacity which can cut latency and power costs for production inference.

The MTIA chips also include hardware support for attention primitives and mixture-of-experts layers, along with low-precision formats tailored to inference to reduce conversion overhead. Software compatibility was a stated priority. Meta says the stack runs natively on common frameworks, so existing production models can be deployed on both GPUs and MTIA without major rewrites, which should ease adoption. Multiple MTIA generations are built to share the same chassis, rack, and networking, allowing upgrades by swapping modules rather than refitting data center infrastructure. That modularity helps explain Meta's fast release cadence compared with the industry norm, considering that Meta's data centers span millions of chips. MTIA chips are already running at kilowatt power budgets and PetaFLOPS of compute, so MTIA accelerators are also competing with industry-leading solutions from NVIDIA, AMD, and other hyperscalers.