Question about Mamba

[CacatuaAlan]

That's an illuminating work! I've noticed MambaVision uses amp which may cause loss NAN in some vision mamba works. How did you sove this?

[ahatamiz]

Thanks @CacatuaAlan . We did not notice the NaN issue. It could be due to combination of using both self-attention and Mamba (just a guess). But would be great if you can provide more details of this issue in previous works.