Company Meta decided to bet on processors with an architecture RISC-V. They have been working on hardware using this architecture for 4 years, and they are to be used for new generations of chips for video encoding, but also for training AI and its inference (running). The first such result is the processor MSVP (Meta’s Scalable Video Processor), which was announced in May of this year. This processor is already mass-produced, even to such an extent that now all tasks (100%) of video processing on social networks Facebook, Messenger and Instagram are already performed on these processors. Prahlad Venkatapuram from the company Meta said that the company has already replaced 85% of all its existing CPUs with these chips, and only 15% is left for other tasks.
Since AI algorithms, both training and inference, will also run on the new Meta processors, they compete with the most powerful AMD and Nvidia GPUs at the same time. AI variant processors are named MIA (Meta Training and Inference Accelerator) and are organized into an 8×8 matrix, where each of these elements has two RISC-V cores, one scalar and one vector, and then there is one more RICS-V core to drive them. The processors are manufactured using 7nm technologies and have a frequency of only 800 MHz. The performance reaches 102.4 GEMM TOPS in INT8 and 51.2 in FP16, all while consuming only 25 W. For comparison, the RTX 4070 Ti has 312 TOPS in FP16 (that is, 6 times as much), but its TDP is 285 W ( more than 11 times). The chip has 128 MB of its own memory with a speed of 800 GB/s and can have up to 128 GB of LPDDR5 RAM with a throughput of 176 GB/s.
2023-12-13 11:52:33
#Meta #switching #RISCV #big #replaced #processors
