Change to mistral-inference
Showing
- README.md 162 additions, 108 deletionsREADME.md
- assets/attention_through_layers.png 0 additions, 0 deletionsassets/attention_through_layers.png
- assets/chunking.png 0 additions, 0 deletionsassets/chunking.png
- assets/full_attention.png 0 additions, 0 deletionsassets/full_attention.png
- assets/kv_padding.png 0 additions, 0 deletionsassets/kv_padding.png
- assets/padding.png 0 additions, 0 deletionsassets/padding.png
- assets/rolling_cache.png 0 additions, 0 deletionsassets/rolling_cache.png
- assets/sliding_attention.png 0 additions, 0 deletionsassets/sliding_attention.png
- mistral/__init__.py 0 additions, 0 deletionsmistral/__init__.py
- mistral/tokenizer.py 0 additions, 36 deletionsmistral/tokenizer.py
- moe_one_file_ref.py 61 additions, 34 deletionsmoe_one_file_ref.py
- one_file_ref.py 130 additions, 106 deletionsone_file_ref.py
- poetry.lock 749 additions, 0 deletionspoetry.lock
- pyproject.toml 49 additions, 0 deletionspyproject.toml
- requirements.txt 0 additions, 5 deletionsrequirements.txt
- src/mistral_inference/__init__.py 1 addition, 0 deletionssrc/mistral_inference/__init__.py
- src/mistral_inference/cache.py 224 additions, 0 deletionssrc/mistral_inference/cache.py
- src/mistral_inference/generate.py 133 additions, 0 deletionssrc/mistral_inference/generate.py
- src/mistral_inference/main.py 183 additions, 0 deletionssrc/mistral_inference/main.py
- src/mistral_inference/model.py 62 additions, 35 deletionssrc/mistral_inference/model.py
Loading
Please register or sign in to comment