v1.1.3

[bghira]

• Nested subdir datasets will now have caches also nested in subdirectories, which unfortunately requires most-likely regenerating these entries. Sorry - it was not feasible to keep the old structure working in parallel.
• FlashAttention3 fixes for H100 nodes by downgrading default torch version to 2.4.1
• Resume fixes for multi-gpu/multi-node state/epoch tracking
• Other misc bugfixes

What's Changed

• fix flux attn masked transformer modeling code by @bghira in fix flux attn masked transformer modeling code #1055
• merge by @bghira in merge #1056
• fix rope function for FA3 by @bghira in fix rope function for FA3 #1057
• merge by @bghira in merge #1058
• lokr: resume by default training state if not found by @bghira in lokr: resume by default training state if not found #1060
• merge by @bghira in merge #1061
• Restore init_lokr_norm functionality by @imit8ed in Restore init_lokr_norm functionality #1065
• refactor how masks are retrieved by @bghira in refactor how masks are retrieved #1066
• nvidia dependency update for pytorch-triton / aiohappyeyeballs by @bghira in nvidia dependency update for pytorch-triton / aiohappyeyeballs #1062
• downgrade cuda to pt241 by default by @bghira in downgrade cuda to pt241 by default #1067
• add nightly build for pt26 by @bghira in add nightly build for pt26 #1068
• Add recropping script for image JSON metadata backends by @AmericanPresidentJimmyCarter in Add recropping script for image JSON metadata backends #1063
• merge by @bghira in merge #1069
• bugfix: restore sampler state on rank 0 correctly by @bghira in bugfix: restore sampler state on rank 0 correctly #1071
• merge by @bghira in merge #1072
• fix vae cache dir creation for subdirs by @bghira in fix vae cache dir creation for subdirs #1076
• fix for nested image subdirs w/ duplicated filenames across subdirs by @bghira in fix for nested image subdirs w/ duplicated filenames across subdirs #1078

New Contributors

• @imit8ed made their first contribution in Restore init_lokr_norm functionality #1065

Full Changelog: v1.1.2...v1.1.3

---

This discussion was created from the release v1.1.3.