If you want to run openclaw locally using something as good as claude - you would need 2x mac studios m3 with 512gb of unified memory each. So $20,000.
For that you would get 20 tokens per second for the rest of your life from KimiK2.5
I've been holding out for an M5. It has new Matrix Multiplication functions in the GPU cores that could be interesting. I can get work to buy one to play with, and yeah, the price tag is pretty blistering!
The price gives me a nosebleed. But it’s “ok-ish” if I could guarantee that it would run cutting edge LLMs for a few years and if my data demanded privacy.
If you want to run openclaw locally using something as good as claude - you would need 2x mac studios m3 with 512gb of unified memory each. So $20,000.
For that you would get 20 tokens per second for the rest of your life from KimiK2.5
I've been holding out for an M5. It has new Matrix Multiplication functions in the GPU cores that could be interesting. I can get work to buy one to play with, and yeah, the price tag is pretty blistering!
The price gives me a nosebleed. But it’s “ok-ish” if I could guarantee that it would run cutting edge LLMs for a few years and if my data demanded privacy.
But for me its cheaper and easier to subscribe.