Opensource AI overtakes Woke AI?
(twitter.com)
You're viewing a single comment thread. View all comments, or full comment thread.
Comments (28)
sorted by:
Iirc, a fair number of smaller-scale self-hostable models are trained/built off of larger models. Either scaled/compressed down or just trained off of to produce models. And often combined with other AI popular model portions to produce hybrid models So we may end up seeing some self-hostable models based off of it eventually.
It's a really weird kind of concept and approach compared to how stuff normally works with anything technical and software related (it would be like building a Photoshop clone by having some software learn from some scripted use of photoshop).
That's sort of my thought process. Small models are getting decent too. I think some mindset is turning into them becoming good at looking things up for example. You ask about video games from 2010 instead of it having to know, it gets good at searching and interpreting. The mega cloud models already do that well.