Yea, come back when you can do this on BOINC.
Well I don’t have 8xH100s, but if I do, I’m probably not gonna donate it a VC-funded company. Remember “Open”AI?
me: Oh cool, a project like Folding@Home but for AI compute, maybe I'll contribute as we- > Decentralized training of INTELLECT-1 currently requires 8x H100 SXM5 GPUs.
me: and for that reason, I'm out
Also they state that later they will be adding the ability for you to contribute your own compute but how will they solve the problem of having to back-propagate to all of the remote nodes contributing to the project without egregiously slow training time?
> Decentralized training of INTELLECT-1 currently requires 8x H100 SXM5 GPUs.
So, your garden-variety $0.5M desktop PC, then.
Cool, cool.
[1] https://viperatech.com/shop/nvidia-dgx-h100-p4387-system-640...
So just spitballing here but this is likely a souped-up reverse engineered DisTrO [0] under the hood, right? Or could it be something else?
This is cool work, I’ve been watching the slow evolution of this space for a couple years and it feels like a good way we can ensure AI is owned and accessible to everyone.
> Prime Intellect
Ah, yes, Prime Intellect, the AGI that went foom and genocided the universe because it was commanded to preserve human civilization without regard for human values. A strong contender for the least evil hostile superintelligence in fiction. What a wonderful thing to name your AI startup after. What's next, creating the Torment Nexus?
(my position on the book as a whole is more complex, but... really? Really?)
You may as well just go with Roko's Basilisk.
Least evil… strong words.
It did host a successful and substantially-satisfying human civilization, at least until it let a couple of presumptuous self-important anarchoprimitivists kill it and genocide its subjects. Even if it was only a temporary and unstable illusion of alignment, that's one more values-satisfying civilization than the overwhelming majority of paperclippers manage. So yeah. Good? No. Least evil? Maybe.
>until it let a couple of presumptuous self-important anarchoprimitivists kill it and genocide its subjects
That could have just been their private simulation. As far as I remember, it wouldn't even have outright lied to them, just let them believe they talked it into destroying itself.
But I can already train from 30 different vendors distributed across the US, why do I need to use a “decentralized” training system? Decentralized inferercing makes more sense as that is where things can be censored
> solve decentralized training step-by-step to ensure AGI will be open-source, transparent, and accessible
One hell of an uncited leap from "we're multiplying a lot of numbers" to "AGI", as if it is a given