jackangel / basic-ui-for-gpt-j-6b-with-low-vram Goto Github PK
View Code? Open in Web Editor NEWThis project forked from arrmansa/basic-ui-for-gpt-j-6b-with-low-vram
A repository to run gpt-j-6b on low vram machines (4.2 gb minimum vram for 2000 token context, 3.5 gb for 1000 token context). Model loading takes 12gb free ram.
License: Apache License 2.0