Add speed benchmark examples (#1068)
* add qwen2.5 perf report
* update readme
* rebuild docs and fix format issue
* remove fuzzy in speed_benchmark.po
* fix issue
* recover function_call.po
* update
* remove unused code in speed_benchmark.po
* add example
* add readme for speed benchmark scripts
* update readme
* update readme
* update
* refine code
* fix pr issue
* fix some issue for PR
* update installation
* add --generate_length param
* update
* update requirements
* Update README_zh.md
* Update README.md
---------
Co-authored-by:
Ren Xuancheng <jklj077@users.noreply.github.com>
Showing
- examples/speed-benchmark/README.md 106 additions, 0 deletionsexamples/speed-benchmark/README.md
- examples/speed-benchmark/README_zh.md 110 additions, 0 deletionsexamples/speed-benchmark/README_zh.md
- examples/speed-benchmark/requirements-perf-transformers.txt 10 additions, 0 deletionsexamples/speed-benchmark/requirements-perf-transformers.txt
- examples/speed-benchmark/requirements-perf-vllm.txt 4 additions, 0 deletionsexamples/speed-benchmark/requirements-perf-vllm.txt
- examples/speed-benchmark/speed_benchmark_transformers.py 170 additions, 0 deletionsexamples/speed-benchmark/speed_benchmark_transformers.py
- examples/speed-benchmark/speed_benchmark_vllm.py 258 additions, 0 deletionsexamples/speed-benchmark/speed_benchmark_vllm.py
examples/speed-benchmark/README.md
0 → 100644
examples/speed-benchmark/README_zh.md
0 → 100644
Please register or sign in to comment