Skip to content
Snippets Groups Projects
Commit b108eedc authored by Jacob Kelly's avatar Jacob Kelly
Browse files

Add a table of H100 inference timings to docs/performance.md

PiperOrigin-RevId: 697644061
parent a08cffd6
No related branches found
No related tags found
1 merge request!1Cloned AlphaFold 3 repo into this one
...@@ -66,6 +66,17 @@ them for numerical accuracy and throughput efficiency: ...@@ -66,6 +66,17 @@ them for numerical accuracy and throughput efficiency:
- 1 NVIDIA A100 (80 GB) - 1 NVIDIA A100 (80 GB)
- 1 NVIDIA H100 (80 GB) - 1 NVIDIA H100 (80 GB)
We compare compile-free inference timings of both configurations in the
following table:
Num Tokens | 1 A100 80 GB (seconds) | 1 H100 80 GB (seconds)
:--------- | ---------------------: | ---------------------:
1024 | 62 | 34
2048 | 275 | 144
3072 | 703 | 367
4096 | 1434 | 774
5120 | 2547 | 1416
### Other Hardware Configurations ### Other Hardware Configurations
#### NVIDIA A100 (40 GB) #### NVIDIA A100 (40 GB)
......
0% Loading or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment