v0.5.4

What's Changed

• Add rocm extra to pyproject.toml (backport #259) by @mergify in #260

Full Changelog: v0.5.3...v0.5.4

v0.5.3

What's Changed

• fix: Add explicit flash_attn requirement for ROCm (backport #255) by @mergify in #258

New Contributors

• @mergify made their first contribution in #258

Full Changelog: v0.5.2...v0.5.3

v0.5.2 - Fix Pretraining Masking

What's Changed

• fix: improve linting and automation by @RobotSail in #172
• Fix pretrain token list->int for masking by @Maxusmusti in #244

Full Changelog: v0.5.1...v0.5.2

v0.5.1

What's Changed

• fix: updates sorting logic to correctly compare numbers by @RobotSail in #238

Full Changelog: v0.5.0...v0.5.1

v0.5.0 FSDP and Full-State Checkpoint Resuming

What's Changed

• fix lint error to make CI happy by @RobotSail in #173
• Add license identifiers by @danmcp in #157
• Fix typos by @danmcp in #158
• feat: add e2e test for instructlab CI by @RobotSail in #174
• Ap/fix multipack for non granite models by @aldopareja in #169
• feat: add mergify by @RobotSail in #187
• ci: update runner labels to uniquely identify instance sizes by @nathan-weinberg in #180
• ci: minor cleanup of E2E job by @nathan-weinberg in #189
• Fixing e2e to use relative path for working-directory by @danmcp in #191
• Fix linting error and missing quote by @danmcp in #192
• Fix typos by @danmcp in #190
• Bump step-security/harden-runner from 2.8.1 to 2.9.1 by @dependabot in #159
• ci: add AWS tags to show github ref and PR num for all jobs by @nathan-weinberg in #196
• Bump pypa/gh-action-pypi-publish from 1.9.0 to 1.10.2 by @dependabot in #219
• Adding FSDP Support to Training Library by @aldopareja @Maxusmusti @RobotSail in #213
• Bump actions/setup-python from 5.1.0 to 5.2.0 by @dependabot in #193
• Bump rhysd/actionlint from 1.7.1 to 1.7.2 in /.github/workflows by @dependabot in #221
• ci: fix lint action by @nathan-weinberg in #227
• Bump hynek/build-and-inspect-python-package from 2.6.0 to 2.9.0 by @dependabot in #198
• Bump DavidAnson/markdownlint-cli2-action from 16.0.0 to 17.0.0 by @dependabot in #199
• Bump step-security/harden-runner from 2.9.1 to 2.10.1 by @dependabot in #224
• Docs: Update training README by @kelbrown20 in #218
• changes StreamablePopen to return a process and implement listening by @JamesKunstle in #229
• switch -T to -a by @cdoern in #222
• github: add stale bot to training repo by @nathan-weinberg in #226
• fix: markdown lint error and mergify bug by @nathan-weinberg in #231
• Bump actions/checkout from 4.1.7 to 4.2.0 by @dependabot in #230
• Fix generic chat template saved to tokenizer for generation by @Maxusmusti in #232
• adds Accelerate full-state (opt, lr_sched, params) by @JamesKunstle in #235

New Contributors

• @danmcp made their first contribution in #157
• @kelbrown20 made their first contribution in #218

Full Changelog: v0.4.2...v0.5.0

v0.5.0 Alpha 0 - The FSDP Release

The FSDP Release

This release of the training library introduces FSDP support in addition to the existing DeepSpeed support through the accelerate library.

What's Changed

• fix lint error to make CI happy by @RobotSail in #173
• Add license identifiers by @danmcp in #157
• Fix typos by @danmcp in #158
• feat: add e2e test for instructlab CI by @RobotSail in #174
• Ap/fix multipack for non granite models by @aldopareja in #169
• feat: add mergify by @RobotSail in #187
• ci: update runner labels to uniquely identify instance sizes by @nathan-weinberg in #180
• ci: minor cleanup of E2E job by @nathan-weinberg in #189
• Fixing e2e to use relative path for working-directory by @danmcp in #191
• Fix linting error and missing quote by @danmcp in #192
• Fix typos by @danmcp in #190
• Bump step-security/harden-runner from 2.8.1 to 2.9.1 by @dependabot in #159
• ci: add AWS tags to show github ref and PR num for all jobs by @nathan-weinberg in #196
• Bump pypa/gh-action-pypi-publish from 1.9.0 to 1.10.2 by @dependabot in #219
• Adding FSDP Support to Training Library by @aldopareja @Maxusmusti @RobotSail in #213
• Bump actions/setup-python from 5.1.0 to 5.2.0 by @dependabot in #193
• Bump rhysd/actionlint from 1.7.1 to 1.7.2 in /.github/workflows by @dependabot in #221
• ci: fix lint action by @nathan-weinberg in #227
• Bump hynek/build-and-inspect-python-package from 2.6.0 to 2.9.0 by @dependabot in #198
• Bump DavidAnson/markdownlint-cli2-action from 16.0.0 to 17.0.0 by @dependabot in #199

New Contributors

• @danmcp made their first contribution in #157

Full Changelog: v0.4.2...v0.5.0a0

v0.4.2

What's Changed

• Provide safeguards during training by @RobotSail in #168

Full Changelog: v0.4.1...v0.4.2

v0.4.1

What's Changed

• makes saving every save_samples an optional feature by @JamesKunstle in #165

Full Changelog: v0.4.0...v0.4.1

v0.4.0

What's Changed

• Change success message at end of training by @alinaryan in #156
• Adds a flag to save checkpoints at the end of an epoch by @JamesKunstle in #160

New Contributors

• @alinaryan made their first contribution in #156

Full Changelog: v0.3.2...v0.4.0

v0.3.2

What's Changed

• patch some hyper parameter arg descriptions in README by @jaideepr97 in #161
• Accept tuples for lora.target_modules by @booxter in #162

New Contributors

• @booxter made their first contribution in #162

Full Changelog: v0.3.1...v0.3.2