Tazik Shahjahan 3678a6c41d Fix: bf16 support for inference (#981) ...

* Fix: bf16 torch dtype

* simplify casting to device and dtype

---------

Co-authored-by: Wing Lian <wing.lian@gmail.com>

2023-12-29 16:15:53 -06:00

..

axolotl

Fix: bf16 support for inference (#981)

2023-12-29 16:15:53 -06:00