Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add FalconBackbone #1475

Merged
merged 16 commits into from
Mar 1, 2024
Merged

Add FalconBackbone #1475

merged 16 commits into from
Mar 1, 2024

Commits on Feb 27, 2024

  1. Add Falcon backbone.

    @SamanehSaadat
    SamanehSaadat committed Feb 27, 2024
    Configuration menu
    Copy the full SHA
    32f7e20 View commit details
    Browse the repository at this point in the history

  2. Add docstring.

    @SamanehSaadat
    SamanehSaadat committed Feb 27, 2024
    Configuration menu
    Copy the full SHA
    1ee93a3 View commit details
    Browse the repository at this point in the history

  3. Add dtype.

    @SamanehSaadat
    SamanehSaadat committed Feb 27, 2024
    Configuration menu
    Copy the full SHA
    051a3f5 View commit details
    Browse the repository at this point in the history

  4. Merge branch 'keras-team:master' into falcon-backbone

    @SamanehSaadat
    SamanehSaadat authored Feb 27, 2024
    Configuration menu
    Copy the full SHA
    ab28feb View commit details
    Browse the repository at this point in the history

  5. Add checkpoint conversion script.

    @SamanehSaadat
    SamanehSaadat committed Feb 27, 2024
    Configuration menu
    Copy the full SHA
    ac697a1 View commit details
    Browse the repository at this point in the history

Commits on Feb 28, 2024

  1. Fix tests.

    @SamanehSaadat
    SamanehSaadat committed Feb 28, 2024
    Configuration menu
    Copy the full SHA
    52662f2 View commit details
    Browse the repository at this point in the history

  2. Random fixes.

    @SamanehSaadat
    SamanehSaadat committed Feb 28, 2024
    Configuration menu
    Copy the full SHA
    1e2c30b View commit details
    Browse the repository at this point in the history

  3. Add cache.

    @SamanehSaadat
    SamanehSaadat committed Feb 28, 2024
    Configuration menu
    Copy the full SHA
    5927eed View commit details
    Browse the repository at this point in the history

  4. Cast cumsum to int32.

    @SamanehSaadat
    SamanehSaadat committed Feb 28, 2024
    Configuration menu
    Copy the full SHA
    8c76d0d View commit details
    Browse the repository at this point in the history

Commits on Feb 29, 2024

  1. Make sublayers public.

    @SamanehSaadat
    SamanehSaadat committed Feb 29, 2024
    Configuration menu
    Copy the full SHA
    838942d View commit details
    Browse the repository at this point in the history

  2. Address backbone comments.

    @SamanehSaadat
    SamanehSaadat committed Feb 29, 2024
    Configuration menu
    Copy the full SHA
    e250755 View commit details
    Browse the repository at this point in the history

  3. Update attention computation to use einsum.

    @SamanehSaadat
    SamanehSaadat committed Feb 29, 2024
    Configuration menu
    Copy the full SHA
    0c94c5c View commit details
    Browse the repository at this point in the history

  4. Falcon only works with Keras3.

    @SamanehSaadat
    SamanehSaadat committed Feb 29, 2024
    Configuration menu
    Copy the full SHA
    6787b20 View commit details
    Browse the repository at this point in the history

  5. Fix tests.

    @SamanehSaadat
    SamanehSaadat committed Feb 29, 2024
    Configuration menu
    Copy the full SHA
    24d705e View commit details
    Browse the repository at this point in the history

  6. Remove falcon_causal_lm file.

    @SamanehSaadat
    SamanehSaadat committed Feb 29, 2024
    Configuration menu
    Copy the full SHA
    7355fd3 View commit details
    Browse the repository at this point in the history

Commits on Mar 1, 2024

  1. Remove commented/unused codes.

    @SamanehSaadat
    SamanehSaadat committed Mar 1, 2024
    Configuration menu
    Copy the full SHA
    72753d8 View commit details
    Browse the repository at this point in the history