forked from jbloomAus/SAELens
-
Notifications
You must be signed in to change notification settings - Fork 0
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
Automatically generated by python-semantic-release
- Loading branch information
github-actions
committed
May 7, 2024
1 parent
2aa2ddd
commit 3265c06
Showing
3 changed files
with
59 additions
and
2 deletions.
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
|
@@ -2,6 +2,63 @@ | |
|
||
|
||
|
||
## v1.5.0 (2024-05-07) | ||
|
||
### Feature | ||
|
||
* feat: Add kl eval (#124) | ||
|
||
* add kl divergence to evals.py | ||
|
||
* fix linter ([`c1d9cbe`](https://github.com/jbloomAus/SAELens/commit/c1d9cbe8627f27f4d5384ed4c9438c3ad350d412)) | ||
|
||
### Unknown | ||
|
||
* major: How we train saes replication (#123) | ||
|
||
* l1 scheduler, clip grad norm | ||
|
||
* add provisional ability to normalize activations | ||
|
||
* notebook | ||
|
||
* change heuristic norm init to constant, report b_e and W_dec norms (fix tests later) | ||
|
||
* fix mse calculation | ||
|
||
* add benchmark test | ||
|
||
* update heuristic init to 0.1 | ||
|
||
* make tests pass device issue | ||
|
||
* continue rebase | ||
|
||
* use better args in benchmark | ||
|
||
* remove stack in get activations | ||
|
||
* broken! improve CA runner | ||
|
||
* get cache activation runner working and add some tests | ||
|
||
* add training steps to path | ||
|
||
* avoid ghost grad tensor casting | ||
|
||
* enable download of full dataset if desired | ||
|
||
* add benchmark for cache activation runner | ||
|
||
* add updated tutorial | ||
|
||
* format | ||
|
||
--------- | ||
|
||
Co-authored-by: Johnny Lin <[email protected]> ([`5f46329`](https://github.com/jbloomAus/SAELens/commit/5f46329d1df90e374d44729966e57542c435d6cf)) | ||
|
||
|
||
## v1.4.0 (2024-05-05) | ||
|
||
### Feature | ||
|
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters