First the official release! 🎉
- Fixed the APIs for tokenizers and dictionaries
- Ready for production usage and long term support
Improvements (since 0.0.4):
- (default-dict) Improve number tokenization consistency
- (default-dict) More compact (3.4 MB)
First the official release! 🎉
Improvements (since 0.0.4):