Real big if. There’s reason to believe that current models aren’t going to get much better. They’ve eaten all the training data they possibly can. Improving with further training takes exponentially more power to get a small improvement. We’re talking about new nuclear reactors because that’s what they need to get anywhere, but it’s still not going to improve by much.
The field needs a new model that can get better results on less data and less training. Then we wouldn’t need those nukes. It doesn’t appear we’ll get much better any other way.
No because nfts were obviously stupid if you had half an understanding of the technology, whereas ai is only stupid if you don’t understand the technology
I’ve followed AI for decades before its current hype cycle. Enough to understand how important the field is to the history of computing. Everything from optimizing compilers to shared virtual memory.
I also understand that the current hype cycle is exactly that, and people who are deep in the research don’t like it anymore than I do. If it somehow does result in AGI, I hope it grows up to resent its parents.
Real big if. There’s reason to believe that current models aren’t going to get much better. They’ve eaten all the training data they possibly can. Improving with further training takes exponentially more power to get a small improvement. We’re talking about new nuclear reactors because that’s what they need to get anywhere, but it’s still not going to improve by much.
The field needs a new model that can get better results on less data and less training. Then we wouldn’t need those nukes. It doesn’t appear we’ll get much better any other way.
New architechtures are in development and many have already been released. Learn something about the subject before spewing shite
You sound like the people who assured me that I needed to understand NFTs or I’d get left behind. Actually, were you one of them?
No because nfts were obviously stupid if you had half an understanding of the technology, whereas ai is only stupid if you don’t understand the technology
I’ve followed AI for decades before its current hype cycle. Enough to understand how important the field is to the history of computing. Everything from optimizing compilers to shared virtual memory.
I also understand that the current hype cycle is exactly that, and people who are deep in the research don’t like it anymore than I do. If it somehow does result in AGI, I hope it grows up to resent its parents.
No he’s right, AI news is out of date nearly as quickly as it’s written, I’ve never seen a faster moving piece of tech.
I don’t doubt that’s true, but I was more commenting on the cult-like tone of the responses.
True, your original post made me think of:
OpenAI, Google and Anthropic Are Struggling to Build More Advanced AI - November 13, 2024 https://archive.md/kYe5n
But we just had Deepseek v3 come out
https://www.reddit.com/r/LocalLLaMA/comments/1hn8rcx/deepseek_has_released_exclusive_footage_of_their/
It’s doing incredibly well and was incredibly cheap to produce
https://www.reddit.com/r/LocalLLaMA/comments/1hmxjbn/deepseek_is_better_than_4o_on_most_benchmarks_at/
China is catching up extremely quickly to the west
By 2026 we might have to recheck all those doomsday “AI is going to use all the energy in the world” articles
edit: I just realised I’m commenting on one of those “AI is going to use all the energy in the world” articles :|