Supermicro launched the Arm-based server ARS-210M-NR in December 2022, and Servethehome tried it, load it with four Nvidia A16 cards. The test server is equipped with a 128-core Ampere Altra Max Arm processor with a main frequency of 3GHz, 16 DDR4 memory sticks (total 512GB memory), 2 25GbE SPF28 interfaces, 16 2.5-inch brackets, and a pair of 2Kw power supplies, all of which are good assembled in a tool-less case.
The cherry on the cake is a quartet of Ampere-based Nvidia A16 graphics cards. Each card features 64GB of GDDR6 ECC memory and four GPUs housed on a full-height, full-length, dual-slot, passively cooled PCB. The A16 isn’t the most powerful data center card Nvidia has; that’s the A100; however, it’s a sweet spot for service providers looking to get the maximum number of concurrent users on a single board.
In terms of pure performance, each of these GPUs has half the CUDA core count of the Geforce RTX 3050, so yes, it should be able to run the legendary Crysis game without any problem, which means that in theory, you could have 16 iterations of one of the most taxing games ever run simultaneously. You just need to create 16 virtual machine and load 16 copies of crysis.
Pricing details were not provided, but given the The A16 retails for about $3,000 with one fully loaded server With similar vouchers costing around $10,000, you can expect to pay over $22,000 for such a system.
the power of the cloud
Now who needs such wanton power?First, cloud gaming is now mainstream (even though Google pulled out when it mothballed earlier this year stadium) and it’s products like the ARS-210M-NR that make it a reality.
But beyond that, it’s also about VDI (Video Desktop Infrastructure) for businesses and businesses.the rise of mixed work Acted as a catalyst for the adoption of Virtual workstation (and Virtual PC) as work at home Become a reality for millions of users.And just one of these servers can hold many VMs (virtual machines); a recent test by a cloud computing company Nutanix demonstrates Two Nvidia A16 graphics cards can handle 128 virtual machines, which means four cards should be able to run 256.
Of course, you may need to deploy a more powerful CPU and more memory than the Altra Max (Nutanix uses 1.5TB RAM and two Intel Xeon Gold 6354, each with 18 physical cores).Added SaaS support for virtual GPUs in a wide range of applications (e.g. Photoshop or chrome alloy) explains why dense servers with very high GPU counts are becoming commonplace.
other applications such as virtual host may benefit from a high CPU core count, which is why VPS (Virtual Private Server) The price gap is so affordable now Private server and bare metal The solution is still high.
Servethehome runs a 2U server Ubuntu While the experience isn’t perfect, it’s definitely worth the effort. Arm is slowly becoming a strong opponent of Intel Xeon and AMD Dragon, and Amazon is also preparing to launch the fourth generation graviton CPU family, now is the perfect time to try Arm.