XLA flags: No speed ups on GPUs and segmentation fault

[AakashKumarNain]

I am developing some code in Equinox and JAX, and running it on A100 GPUs. As per the JAX GPU tips, some operations should provide better performance.

On my end, I don't see any difference in the performance after enabling these flags. Also, some flags like --xla_gpu_enable_triton_softmax_fusion=true results in segmentation fault. Please check the detailed description in the related issue

[cheshire]

Performance flags are not considered to be stable/supported/safe API to use.

[hawkinsp]

@cheshire I don't think that's a realistic description of the current state. The current state is that because we haven't succeeded at landing many useful flags as defaults, lots of users can and do have to override XLA flags.

While we may not expect performance improvements from doing that, I think the segfault at least is a real bug and shouldn't be summarily closed.