Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Keep rope at float32 precision #1497

Merged
merged 5 commits into from
Mar 13, 2024
Merged

Keep rope at float32 precision #1497

merged 5 commits into from
Mar 13, 2024

Commits on Mar 7, 2024

  1. Keep rope at float32 precision

    @grasskin
    grasskin authored Mar 7, 2024
    Configuration menu
    Copy the full SHA
    c0c518c View commit details
    Browse the repository at this point in the history

Commits on Mar 12, 2024

  1. Carry out all of RoPE in float32

    @grasskin
    grasskin committed Mar 12, 2024
    Configuration menu
    Copy the full SHA
    90cca66 View commit details
    Browse the repository at this point in the history

  2. Formatting

    @grasskin
    grasskin committed Mar 12, 2024
    Configuration menu
    Copy the full SHA
    50f26cb View commit details
    Browse the repository at this point in the history

  3. Cleanup

    @grasskin
    grasskin committed Mar 12, 2024
    Configuration menu
    Copy the full SHA
    854d7b4 View commit details
    Browse the repository at this point in the history

Commits on Mar 13, 2024

  1. Do not cast x

    @grasskin
    grasskin committed Mar 13, 2024
    Configuration menu
    Copy the full SHA
    3d40750 View commit details
    Browse the repository at this point in the history