United States: Meta shares details of upgraded MTIA AI chips

Meta has shared details about the next generation of its Meta Training and Inference Accelerator (MTIA), custom-made chips designed for specific Meta AI workloads. The company said the latest version of its chips shows significant performance improvements over the MTIA v1 and is already being used to support generative AI products and services, such as Meta’s ranking and recommendation advertising models.

“We’re designing our custom silicon to work in cooperation with our existing infrastructure as well as with new, more advanced hardware (including next-generation GPUs) that we may leverage in the future,” wrote Joel Coburn, software engineer at Facebook; Eran Tal, director of hardware systems at Facebook; and Nicolaas Viljoen, technical lead director of AI/HPC systems at Meta, in a blog post announcing MTIA v2.

“Meeting our ambitions for our custom silicon means investing not only in compute silicon but also in memory bandwidth, networking, and capacity as well as other next-generation hardware systems. We currently have several programs underway aimed at expanding the scope of MTIA, including support for GenAI workloads.”