* Add MoE and Pipelining support

* Update readme

* Update requirements

* Add faster loading 

* Make sliding window optional and add rope_theta with smart default

---------

Co-authored-by: devendrachaplot <devendrachaplot@gmail.com>