Data centers that process video can now use the company’s special accelerators AMD (or companies Xilinx, which AMD bought). My name is Alveo MA35D and these ASICs are manufactured using 5nm technology which allows to achieve good efficiency. The VPU (Video Processing Unit) in these add-on cards handle 32 streams in Full HD 1080p60 or 4 streams in 4K60p for H.264 and H.265 codecs. But they manage even better results in AV1. Here it is already 64 Full HD streams in 1080p60, 8 streams in 4K60p or 4 streams in 8K30p. It manages Full HD with a consumption of about 1 W per stream (in total it should be about 35 W). For comparison, the previous Alveo U30 needed around 3 W. The cards fit into a 50W TDP.
If you use a 1U rack with eight such cards, you can process up to 256 streams in H.264/H.265 at once. Total performance reaches 22 TOPS. The card has the HHHL size format and occupies one slot, it is intended for the PCIe Gen4/Gen5 x8 bus. It contains 16 GB of LPDDR5 memory and the interesting thing is that it can do with passive cooling. As for the price, it has been set at $1595.