DEV Community

Cover image for Thoroughly experimented with Fine-Tuning / DreamBooth training of Flux-dev-de-distill, PixelWave v03, Verus Vision
Furkan Gözükara
Furkan Gözükara

Posted on

Thoroughly experimented with Fine-Tuning / DreamBooth training of Flux-dev-de-distill, PixelWave v03, Verus Vision

Thoroughly experimented with Fine-Tuning / DreamBooth training of Flux-dev-de-distill, PixelWave v03, Verus Vision and base FLUX Dev model. Moreover, I have tried multi-concept training with training Dwayne Johnson and myself together as 2 concepts. Furthermore, tested class overwriting problem

For these experiments, I used 28 images of myself (subset from my 256 images) and 28 images of Dwayne Johnson — perfect quality shots

I have published a very detailed article with full grids and more info here : https://www.patreon.com/posts/114969137

However my findings as summary as below:

You can Fine-Tune / DreamBooth fully community trained models with Kohya GUI such as PixelWave v03, Flux-dev-de-distill or Verus Vision

Actually this was not possible few days ago but after I reported error to the Kohya he fixed, amazing developer

The configs and workflow I researched for official FLUX DEV model perfectly works on community trained models with no changes

PixelWave v03 is not good for realism training, overfit model

Flux-dev-de-distill and Verus Vision close and i think Flux-dev-de-distill better

Flux-dev-de-distill is almost as quality as FLUX DEV but unless you want to train multiple-concept at once, I don’t see any reason to use it yet

Flux-dev-de-distill still has bleeding / mixing problem but it is slightly reduced compared to FLUX DEV official model

Flux-dev-de-distill still has class info overwriting problem

Analyzing full size grids will give you way more idea and information

As a next research, hopefully I will fully train SD 3.5 Large and Medium models, find best training hyperparameters for LoRA and Fine-Tuning / DreamBooth trainings

Then hopefully we will see fix this insane bleeding / mixing + class info overwriting problem exists there too or not

Kohya keep updating and applying fixes

Top comments (0)