Apple Mac Studio enables AI clusters via Thunderbolt 5

Apple has introduced a hardware innovation for the Mac Studio designed to assist AI developers and data scientists. The new system allows multiple Mac Studio units to be interconnected into high-performance computing clusters.

By utilizing Thunderbolt 5 interfaces and Remote Direct Memory Access (RDMA) technology, the devices can create a massive shared memory pool. This allows the machines to bypass standard operating system overhead to access remote memory directly. This capability enables the local running and testing of large-scale open-weight AI models that would typically exceed the memory capacity of a single workstation.

According to Apple, connecting four Mac Studio units into a single cluster can result in up to three times the speed during AI inference compared to using a single standalone machine. This positioning offers a scalable alternative to expensive server setups for AI training and deployment.