Dan Saunders b8c633aa97 batch api HF adapter for ring-flash-attn; cleanup and improvements (#2520) ...

* batch api HF adapter for ring-flash-attn; cleanup and improvements

* update

* adding all batch ring-flash-attn methods via single adapter

* removing pad_to_sequence_len=False for now

* fix

* updating docs to include batch SP

* review comments

* fixes for batch API funcs, simplify

* fixes

* fix

* updates

* add batch_zigzag smoke test

2025-04-16 13:50:48 -04:00

3.7 KiB

Raw Blame History

View Raw