Skip to content
Snippets Groups Projects
Commit 5d4cc685 authored by Patrick von Platen's avatar Patrick von Platen
Browse files

WIP

parent d37fbb54
No related branches found
No related tags found
No related merge requests found
......@@ -152,7 +152,6 @@ class BufferCache:
head_dim: int,
sliding_window: Optional[int] | Optional[List[int]] = None,
):
print(f"yeeeees {sliding_window}")
self.max_seq_len = max_seq_len
self.n_kv_heads = n_kv_heads
self.head_dim = head_dim
......
0% Loading or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment