Sidero Labs announced an open-source OS for private AI on your own hardware, plus a commercial console on top. What is in it, why we care, and what we want to test.
We put an on-prem GPU and a rented cloud GPU behind one endpoint, killed the on-prem GPU mid-test, and lost 0 of 600 requests. What we built, what we measured, and what is still open.