- Fixed the misspelling of "inferred" in the ModelArgs docstring.
- Changed "infered" to "inferred" to maintain proper spelling and clarity in the documentation.

* Add MoE and Pipelining support

* Update readme

* Update requirements

* Add faster loading 

* Make sliding window optional and add rope_theta with smart default

---------

Co-authored-by: devendrachaplot <devendrachaplot@gmail.com>