v0.4.2

What's Changed

• Provide safeguards during training by @RobotSail in #168

Full Changelog: v0.4.1...v0.4.2

v0.4.1

What's Changed

• makes saving every save_samples an optional feature by @JamesKunstle in #165

Full Changelog: v0.4.0...v0.4.1

v0.4.0

What's Changed

• Change success message at end of training by @alinaryan in #156
• Adds a flag to save checkpoints at the end of an epoch by @JamesKunstle in #160

New Contributors

• @alinaryan made their first contribution in #156

Full Changelog: v0.3.2...v0.4.0

v0.3.2

What's Changed

• patch some hyper parameter arg descriptions in README by @jaideepr97 in #161
• Accept tuples for lora.target_modules by @booxter in #162

New Contributors

• @booxter made their first contribution in #162

Full Changelog: v0.3.1...v0.3.2

v0.3.1

What's Changed

• Update requirements to have bitsandbytes min and dolomite min by @Maxusmusti in #153

Full Changelog: v0.3.0...v0.3.1

v0.3.0

What's Changed

• remove dead code by @RobotSail in #138
• Updating token masking to support pretraining w/ masked special tokens by @Maxusmusti in #137
• fix: changes the check to check against both the enum option and enum value. Currently when we compare the type that gets passed in from the training args by only doing a check against the enum by @RobotSail in #143
• Adding weight merging for LoRA/QLoRA ckpts by @Maxusmusti in #142

Full Changelog: v0.2.0...v0.3.0

v0.2.0

What's Changed

• Bump actions/download-artifact from 4.1.7 to 4.1.8 by @dependabot in #127
• Fix ckpt save to include architecture for inference runtime consumption by @Maxusmusti in #129
• Reducing deepspeed timeout to 10mins by @Maxusmusti in #132
• Logging updates by @Maxusmusti in #134

Full Changelog: v0.1.0...v0.2.0

v0.1.0

What's Changed

• Reduce Unnecessary Multiprocessing by @Maxusmusti in #79
• Flash Attention Disable Toggle (Take 2) by @Maxusmusti in #118
• 🐛: fix optimizer selection logic so that FusedAdam is never loaded when CPU offloading is enabled by @RobotSail in #122
• Add wheel to requirements by @Maxusmusti in #123

Full Changelog: v0.0.5.1...v0.1.0

Updates Lazy Import Logic

This release includes PR #121 to overcome an issue where our way of lazily importing the run_training function is being picked up as an error by pylint.

v0.0.5

Minor bugfixes and updates.