Aman Gupta Karmani 72a6fe1c1f use flash_attn rmsnorm when available (#526) ...

* use flash_attn xentropy when available

* use flash_attn.ops.rms_norm when available

* log when xentropy is not found

* log how to install RMSNorm

* add quotes so pip install works

2023-09-04 19:44:51 -04:00

..

axolotl

use flash_attn rmsnorm when available (#526)

2023-09-04 19:44:51 -04:00