It’s a big field!

But if you’re in a few discords and a bunch of subreddits, you’re doing it right.

The most interesting stuff happens in GitHub PR’s, but you have to know where to look. Kohya’s misnamed SD3 branch has a ton of good flux hints, for example. It’s also where furkan gets pretty much all his content, before it gets paywalled.

Unfortunately, unless you participate full-time it’s hard to follow along. But if you really dig in and learn to modify your tooling (Comfy, kohya etc), you’ll start to come across some really impressive people who are all self-taught, and very accessible.

It’s totally possible to work your way up to the frontier with a few months of hacking. (And disposable income for GPU time.)

And the overlap between image AI’s and LLM’s is actually pretty great since they’re all transformers under the hood.

Civit, in my experience, is a good source for weights but most of the guides are written by people without much actual experience.

If you haven’t already, use tensorflow or wandb to get an intuitive understanding of your training parameters. It’s very easy to connect your tools to these services. This is by far the most helpful thing I’ve done, and something I really regret not doing sooner.

r/LocalLLaMA