Meta collaborates with TSMC to produce training chip – Reuters

Meta collaborates with TSMC to produce training chip – Reuters

Meta, the social media giant, has recently announced its collaboration with Taiwan Semiconductor Manufacturing Company (TSMC) to produce its next-generation AI chip, MTIA [1]. This upgrade from Meta's current MTIA v1 chip is expected to bring significant improvements in compute, memory bandwidth, and memory capacity.

The new MTIA chip is being manufactured on TSMC's advanced 5nm process node, a significant upgrade from the 7nm process node used for the previous generation [1]. This collaboration is noteworthy as TSMC is a leading semiconductor manufacturer and is known for its innovative process technologies.

Meta's primary focus with the new MTIA chip is to provide the right balance of compute, memory bandwidth, and memory capacity for serving ranking and recommendation models [1]. The chip's architecture is designed to provide high utilization even with relatively low batch sizes and increased compute when experiencing larger amounts of potential concurrent work [1].

One of the most significant differences between the new MTIA chip and its predecessor is the type of memory used. While the previous MTIA chip used server DRAM or LPDDR5 memory, the new MTIA chip uses low-power DRAM memory (LPDDR5) instead [1]. This decision was made to improve the efficiency of the chip and to better suit Meta's unique workload requirements.

Meta's collaboration with TSMC is expected to bring significant improvements to the company's AI capabilities. With the increased efficiency and improved performance of the new MTIA chip, Meta will be better equipped to provide personalized recommendations and improve user experiences across its platforms.

In conclusion, Meta's collaboration with TSMC to produce its next-generation AI chip is a significant development in the world of AI and semiconductor manufacturing. The new MTIA chip, manufactured on TSMC's advanced 5nm process node, is expected to bring significant improvements in compute, memory bandwidth, and memory capacity, making it a game-changer for Meta's AI capabilities.

References:
[1] Tweaktown. (2023, March 15). Meta's next-gen in-house AI chip is made on TSMC's 5nm process with LPDDR5 RAM, not HBM. Tweaktown. https://www.tweaktown.com/news/97485/metas-next-gen-in-house-ai-chip-is-made-on-tsmcs-5nm-process-with-lpddr5-ram-not-hbm/index.html