Thoroughly experimented with Fine-Tuning / DreamBooth training of Flux-dev-de-distill, PixelWave v03, Verus Vision and base FLUX Dev model. Moreover, I have tried multi-concept training with training Dwayne Johnson and myself together as 2 concepts. Furthermore, tested class overwriting problem
For these experiments, I used 28 images of myself (subset from my 256 images) and 28 images of Dwayne Johnson — perfect quality shots
I have published a very detailed article with full grids and more info here : https://www.patreon.com/posts/114969137
However my findings as summary as below:
You can Fine-Tune / DreamBooth fully community trained models with Kohya GUI such as PixelWave v03, Flux-dev-de-distill or Verus Vision
Actually this was not possible few days ago but after I reported error to the Kohya he fixed, amazing developer
The configs and workflow I researched for official FLUX DEV model perfectly works on community trained models with no changes
PixelWave v03 is not good for realism training, overfit model
Flux-dev-de-distill and Verus Vision close and i think Flux-dev-de-distill better
Flux-dev-de-distill is almost as quality as FLUX DEV but unless you want to train multiple-concept at once, I don’t see any reason to use it yet
Flux-dev-de-distill still has bleeding / mixing problem but it is slightly reduced compared to FLUX DEV official model
Flux-dev-de-distill still has class info overwriting problem
Analyzing full size grids will give you way more idea and information
As a next research, hopefully I will fully train SD 3.5 Large and Medium models, find best training hyperparameters for LoRA and Fine-Tuning / DreamBooth trainings
Then hopefully we will see fix this insane bleeding / mixing + class info overwriting problem exists there too or not
Kohya keep updating and applying fixes
Top comments (0)