As we discuss trends in the server industry with different organizations, one of the clear trends has been a migration toward more accelerated computing servers. Sometimes these are standard rack servers with a GPU like a NVIDIA T4 for inference. Other times, these are large acceleration and training-focused servers. Leaning into this trend, we have the ASRock Rack 2U4G-ROME/2T server that utilizes a single AMD EPYC CPU and can handle up to four double-width GPUs in 2U.
…
Read more