Skip to content

Commit

Permalink
1.5.0
Browse files Browse the repository at this point in the history
Automatically generated by python-semantic-release
  • Loading branch information
github-actions committed May 7, 2024
1 parent 2aa2ddd commit 3265c06
Show file tree
Hide file tree
Showing 3 changed files with 59 additions and 2 deletions.
57 changes: 57 additions & 0 deletions CHANGELOG.md
Original file line number Diff line number Diff line change
Expand Up @@ -2,6 +2,63 @@



## v1.5.0 (2024-05-07)

### Feature

* feat: Add kl eval (#124)

* add kl divergence to evals.py

* fix linter ([`c1d9cbe`](https://github.com/jbloomAus/SAELens/commit/c1d9cbe8627f27f4d5384ed4c9438c3ad350d412))

### Unknown

* major: How we train saes replication (#123)

* l1 scheduler, clip grad norm

* add provisional ability to normalize activations

* notebook

* change heuristic norm init to constant, report b_e and W_dec norms (fix tests later)

* fix mse calculation

* add benchmark test

* update heuristic init to 0.1

* make tests pass device issue

* continue rebase

* use better args in benchmark

* remove stack in get activations

* broken! improve CA runner

* get cache activation runner working and add some tests

* add training steps to path

* avoid ghost grad tensor casting

* enable download of full dataset if desired

* add benchmark for cache activation runner

* add updated tutorial

* format

---------

Co-authored-by: Johnny Lin <[email protected]> ([`5f46329`](https://github.com/jbloomAus/SAELens/commit/5f46329d1df90e374d44729966e57542c435d6cf))


## v1.4.0 (2024-05-05)

### Feature
Expand Down
2 changes: 1 addition & 1 deletion pyproject.toml
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
[tool.poetry]
name = "sae-lens"
version = "1.4.0"
version = "1.5.0"
description = "Training and Analyzing Sparse Autoencoders (SAEs)"
authors = ["Joseph Bloom"]
readme = "README.md"
Expand Down
2 changes: 1 addition & 1 deletion sae_lens/__init__.py
Original file line number Diff line number Diff line change
@@ -1,4 +1,4 @@
__version__ = "1.4.0"
__version__ = "1.5.0"

from .training.activations_store import ActivationsStore
from .training.cache_activations_runner import CacheActivationsRunner
Expand Down

0 comments on commit 3265c06

Please sign in to comment.