Skip to content

Add prefill 8B f16 torch sdpa test, update tests with compile flags and tp flags, with nightly iree #2470

Add prefill 8B f16 torch sdpa test, update tests with compile flags and tp flags, with nightly iree

Add prefill 8B f16 torch sdpa test, update tests with compile flags and tp flags, with nightly iree #2470