Trained Myself With 256 Images on FLUX — Results Mind Blowing
Detailed Full Workflow
Medium article : https://medium.com/@furkangozukara/ultimate-flux-lora-training-tutorial-windows-and-cloud-deployment-abb72f21cbf8
Windows main tutorial : https://youtu.be/nySGu12Y05k
Cloud tutorial for GPU poor or scaling : https://youtu.be/-uhL2nW7Ddw
Full detailed results and conclusions : https://www.patreon.com/posts/111891669
Full config files and details to train : https://www.patreon.com/posts/110879657
SUPIR Upscaling (default settings are now perfect) : https://youtu.be/OYxVEvDf284
I used my Poco X6 Camera phone and solo taken images
My dataset is far from being ready, thus I have used so many repeating and almost same images, but this was rather experimental
Hopefully I will continue taking more shots and improve dataset and reduce size in future
I trained Clip-L and T5-XXL Text Encoders as well
Since there was too much push from community that my workflow won’t work with expressions, I had to take a break from research and use whatever I have
I used my own researched workflow for training with Kohya GUI and also my own self developed SUPIR app batch upscaling with face upscaling and auto LLaVA captioning improvement
Download images to see them in full size, the last provided grid is 50% downscaled
Workflow
Gather a dataset that has expressions and perspectives that you like after training, this is crucial, whatever you add, it can generate perfect
Follow one of the LoRA training tutorials / guides
After training your LoRA, use your favorite UI to generate images
I prefer SwarmUI and here used prompts (you can add specific expressions to prompts) including face inpainting :
https://gist.github.com/FurkanGozukara/ce72861e52806c5ea4e8b9c7f4409672
After generating images, use SUPIR to upscale 2x with maximum resemblance
Short Conclusions
Using 256 images certainly caused more overfitting than necessary
Detailed Full Workflow
Medium article : https://medium.com/@furkangozukara/ultimate-flux-lora-training-tutorial-windows-and-cloud-deployment-abb72f21cbf8
Windows main tutorial : https://youtu.be/nySGu12Y05k
Cloud tutorial for GPU poor or scaling : https://youtu.be/-uhL2nW7Ddw
Full detailed results and conclusions : https://www.patreon.com/posts/111891669
Full config files and details to train : https://www.patreon.com/posts/110879657
SUPIR Upscaling (default settings are now perfect) : https://youtu.be/OYxVEvDf284
I used my Poco X6 Camera phone and solo taken images
My dataset is far from being ready, thus I have used so many repeating and almost same images, but this was rather experimental
Hopefully I will continue taking more shots and improve dataset and reduce size in future
I trained Clip-L and T5-XXL Text Encoders as well
Since there was too much push from community that my workflow won’t work with expressions, I had to take a break from research and use whatever I have
I used my own researched workflow for training with Kohya GUI and also my own self developed SUPIR app batch upscaling with face upscaling and auto LLaVA captioning improvement
Download images to see them in full size, the last provided grid is 50% downscaled
Workflow
Gather a dataset that has expressions and perspectives that you like after training, this is crucial, whatever you add, it can generate perfect
Follow one of the LoRA training tutorials / guides
After training your LoRA, use your favorite UI to generate images
I prefer SwarmUI and here used prompts (you can add specific expressions to prompts) including face inpainting :
https://gist.github.com/FurkanGozukara/ce72861e52806c5ea4e8b9c7f4409672
After generating images, use SUPIR to upscale 2x with maximum resemblance
Short Conclusions
Using 256 images certainly caused more overfitting than necessary