Models will be downloaded into:
My Documents/chato
# clone repo:
git clone https://github.com/danielesteban/chato.git
cd chato
# install dependencies:
pnpm install
# build app backend:
pnpm build:app
# build ui:
pnpm build:ui
# start app:
pnpm app
- Build Tools for Visual Studio 2022
- Select "Desktop development with C++"
- Install the MSVC v143 and the Windows 11 SDK
- CUDA Toolkit 12.3
Copy all files from:
C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.3\extras\visual_studio_integration\MSBuildExtensions
into:
C:\Program Files (x86)\Microsoft Visual Studio\2022\BuildTools\MSBuild\Microsoft\VC\v170\BuildCustomizations
(The paths may vary depending on your installation/version)
# recompile node-llama-cpp with CUDA support:
pnpm cuda