v1.7.0

What's Changed

• Add start_at_layer parameter to HookedTransformer by @UFO-101 in #382
• fix: Set IGNORE value in mask to -torch.inf by @connor-henderson in #366
• bug fix attention inf by @jbloomAus in #389
• Bugfix attn left padding by @jbloomAus in #390
• Add developer tooling defaults & VS Code extensions by @alan-cooney in #394
• Fix llama tokenization issue by using tokenizer initialized with add_bos_token=True by @soheeyang in #379
• Move towards consistent commenting/docstring style by @alan-cooney in #395
• Speed up docs generation by @alan-cooney in #396
• Add hook_attn_in by @ArthurConmy in #336
• Added explicit dtype option by @neelnanda-io in #388
• Support PyTorch 2 with Poetry by @alan-cooney in #397
• Remove .venv from formatting checks by @alan-cooney in #401
• Add auto-organise imports on save in VsCode by @alan-cooney in #410
• Fix SolidGoldMagikarp tokenization test by @ArthurConmy in #408
• Add a summary docstring to the sub-modules by @alan-cooney in #407
• Remove unused root directory files by @alan-cooney in #406
• Simplify Docs Generation by @alan-cooney in #398
• Fix GitHub pages deploy by @alan-cooney in #412
• Fix optional types in HookedTransformer by @alan-cooney in #403
• Improve Hooked Transformer Docs by @alan-cooney in #400
• Improve API Docs Organization by @alan-cooney in #399
• Add docstring testing by @alan-cooney in #402
• Fix tokenization in utils.test_prompt by @Felhof in #334

New Contributors

• @UFO-101 made their first contribution in #382
• @connor-henderson made their first contribution in #366

Full Changelog: v1.6.1...v1.7.0