Meta’s new AI chips will begin production in September

In an effort to cut its GPU costs amid an unprecedented component shortage, Meta is on track to start making the latest versions of its AI chip in September, Reuters I mentionedQuoted from an internal memo.

At least one chip passed the testing phase in about six weeks, the memo said. Meta is working with Broadcom to design the chips, but will use Taiwan Semiconductor Manufacturing Company (TSMC) to manufacture them. It also buys RAM from Samsung, storage from SanDisk, and fiber-optic equipment from Sumitomo Electric, according to the report.

dead detailed The four new chips, developed under the Meta Training and Inference Accelerator (MTIA) programme, were launched in March, and some are currently in deployment or will be deployed this year or next. The company is taking a modular approach to designing these chips, and expects its needs to change as artificial intelligence develops rapidly by the time the chips are produced.

“Each generation of MTIA builds on the last generation, using standardized chipsets, incorporating the latest AI workload insights and hardware technologies, and deploying on a shorter cadence,” the company wrote at the time.

The chips are expected to help the company save money on purchasing GPUs from chipmakers like Nvidia and AMD, though it still expects to spend a lot with those providers as well, Reuters reports. Meta intends to use MTIA chips for training models for classification and recommendation algorithms, broader AI workloads, and inference targeting its applications. It was a social media company Producing its own AI chips since 2023.

Meta has spent heavily on securing enough computing capacity to support its various AI efforts. The company said in April expected Capital expenditures range between $125 billion and $145 billion this year, much of it going toward artificial intelligence efforts.

The company has closed deals for data and power centers around the world, and has spent tens of billions to secure the computing power to train and deploy its new system. Moses Spark A series of artificial intelligence models. It plans to deploy 7 gigawatts of computing this year, and double that next year, according to Reuters, which cited the memo.

It is too I signed a deal with ARM last year to secure computing for its recommendation systems, as well as a multibillion-dollar deal with… AMD for Instinct GPUs A multi-billion dollar deal Amazon uses the cloud giant’s local CPUs For needs related to artificial intelligence.

Meta isn’t the only company trying to stem the flow of capital to Nvidia. OpenAI last month unveil An inference processor it is building with Broadcom, and Anthropic is said to be considering it Developing its own chips With Samsung. Amazon and Google Both are developing their own chips for AI training and inference, and there are Startup Host Construction in space to meet growing demand.

Meta declined to comment.