guokelei1 / infinigen Goto Github PK
View Code? Open in Web Editor NEWThis project forked from snu-comparch/infinigen
InfiniGen: Efficient Generative Inference of Large Language Models with Dynamic KV Cache Management (OSDI'24)
License: Apache License 2.0