Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Video swin #2319

Closed
wants to merge 32 commits into from
Closed

Video swin #2319

wants to merge 32 commits into from

Conversation

innat
Copy link
Contributor

@innat innat commented Jan 27, 2024

What does this PR do?

Fixes #2262

Before submitting

  • This PR fixes a typo or improves the docs (you can dismiss the other checks if that's the case).
  • Did you read the contributor guideline,
    Pull Request section?
  • Was this discussed/approved via a Github issue? Please add a link
    to it if that's the case.
  • Did you write any new necessary tests?
  • If this adds a new model, can you run a few training steps on TPU in Colab to ensure that no XLA incompatible OP are used?

Who can review?

Anyone in the community is free to review the PR once the tests have passed. Feel free to tag
members/contributors who may be interested in your PR.

innat and others added 29 commits January 21, 2024 00:32
@innat
add: video siwn mlp layer
c1eaeb5
@innat
add patch embed 3d
14b1825
@innat
add patch merging layer
5d33506
@innat
add window attention layer in 3d
8dcf7e2
@innat
add utility methods for video swin
9d0bca4
@innat
add basic layer of video swin
bfd54d7
@innat
add 3d swin transformer block
03f3b11
@innat
add keras_cv_export on window attention and swin block
c8f6a90
@innat
simplify the mlp layer's argument name
23a1d71
@innat
update mlp layer: instance to identifier
27de752
@innat
update mlp calls
e493fa5
@innat
add docstring to mlp layer
cf13394
@innat
update patch embedding layer
5291e74
@innat
add docstring to patch embedding layer
ec6a005
@innat
update patch merging layer
1e3ae30
@innat
update window attention
512c71d
@innat
update swin transformer block
610c6ba
@innat
update swin basic layer
a158711
@innat
run formatters
dcf01bb
update docstring and restructure call method of SwinTransformerBlock3…
5eedb9f 
…D layer
remove return_attention_maps argument from call method
f13e697
create video_swin_transformer_layers_test file
276f1b3
add TestPatchEmbedding3D
b31f78f
update window attention layer and add init test case
55a70ae
update window attention test case
4298869
update siwn transformer block and add test file
d8e98b1
update siwn transformer test file
e1f3d30
run formatter
2636d9b
add layers api to init
3f26791
@google-cla Google CLA
Copy link

google-cla bot commented Jan 27, 2024

Thanks for your pull request! It looks like this may be your first contribution to a Google open source project. Before we can look at your pull request, you'll need to sign a Contributor License Agreement (CLA).

View this failed invocation of the CLA check for more information.

For the most up to date status, view the checks section at the bottom of the pull request.

@innat innat marked this pull request as draft January 27, 2024 13:33
@tirthasheshpatel tirthasheshpatel mentioned this pull request Feb 1, 2024
Open
@innat innat closed this Mar 1, 2024
@innat innat deleted the video_swin branch March 1, 2024 05:08
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@sampathweb sampathweb Awaiting requested review from sampathweb

Assignees

@tirthasheshpatel tirthasheshpatel

Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.

Add Video Swin Transformer Model
2 participants
@innat @tirthasheshpatel