It's already very difficult to use "paid" AI without verifying who you are. It can be done with prepaid credit cards that allow you to create a fake profile for the prepaid card but this is getting increasingly difficult.
At the end of the day, you should be using offline AI anyway if you want to remain anonymous. Cloud AI is terrible for remaining anonymous. Even if you don't tie anything that can identify you, the more you use it the more likely it'll figure everything about you out enough to identify you.
This is not viable in the current hardware and software landscape. If new software architecture comes out that replaces transformers, maybe. If chinese memory manufacturing comes online and drops the cost of vram by 90%, maybe. I don't think we're going to quantize our way into a 24GB gddr card replacing a 140GB hbm module.
Right now if you want to run a top end model you're gonna need $50,000 of hardware and it's still not going to be as good as claude. The only sector where local is out performing cloud is generating porn.
Local outperforms cloud for very specific tasks not for general AI. If the AI model is niche then local will work better simply because it isn't censored unlike general AI.
You're right, for now. In 15 years though, our phones will probably be able to run local AI better than the $50k tech today.
I don't see any other avenue if you want anonymity though.
Doubt they will increase phone performance much in the future. They will just keep the best tech for governments and companies. And the end user will get a little more storage and maybe a better battery.
Maybe but that hasn't been the case so far. I could see the government and companies colluding to ensure people never have sufficient hardware to run local AI.
No but you can get a 128 GB unified memory mac that can send 124 GB of it to the graphics card with an admin command for less than a 19 year old Ford Crown Victoria.
It's already very difficult to use "paid" AI without verifying who you are. It can be done with prepaid credit cards that allow you to create a fake profile for the prepaid card but this is getting increasingly difficult.
At the end of the day, you should be using offline AI anyway if you want to remain anonymous. Cloud AI is terrible for remaining anonymous. Even if you don't tie anything that can identify you, the more you use it the more likely it'll figure everything about you out enough to identify you.
Offline AI is the only way forward.
This is not viable in the current hardware and software landscape. If new software architecture comes out that replaces transformers, maybe. If chinese memory manufacturing comes online and drops the cost of vram by 90%, maybe. I don't think we're going to quantize our way into a 24GB gddr card replacing a 140GB hbm module.
Right now if you want to run a top end model you're gonna need $50,000 of hardware and it's still not going to be as good as claude. The only sector where local is out performing cloud is generating porn.
Local outperforms cloud for very specific tasks not for general AI. If the AI model is niche then local will work better simply because it isn't censored unlike general AI.
You're right, for now. In 15 years though, our phones will probably be able to run local AI better than the $50k tech today.
I don't see any other avenue if you want anonymity though.
Doubt they will increase phone performance much in the future. They will just keep the best tech for governments and companies. And the end user will get a little more storage and maybe a better battery.
Maybe but that hasn't been the case so far. I could see the government and companies colluding to ensure people never have sufficient hardware to run local AI.
No but you can get a 128 GB unified memory mac that can send 124 GB of it to the graphics card with an admin command for less than a 19 year old Ford Crown Victoria.