Wing Lian 5e9fa33f3d reduce test concurrency to avoid HF rate limiting, test suite parity (#2128) ...

* reduce test concurrency to avoid HF rate limiting, test suite parity

* make val_set_size smaller to speed up e2e tests

* more retries for pytest fixture downloads

* val_set_size was too small

* move retry_on_request_exceptions to data utils and add retry strategy

* pre-download ultrafeedback as a test fixture

* refactor download retry into it's own fn

* don't import from data utils

* use retry mechanism now for fixtures

2024-12-06 10:20:20 -05:00

3.6 KiB

Raw Blame History

View Raw