Summary
Majestic Labs, a startup founded by former Google and Meta engineers, has unveiled its Prometheus server, designed to challenge Nvidia's GPU and HBM approach for AI inference. The Prometheus server utilizes custom Arm cores and up to 128TB of LPDDR6 RAM, aiming to provide significantly more memory per processor at a lower cost and power consumption.