Models will be downloaded into: My Documents/chato

# clone repo:
git clone https://github.com/danielesteban/chato.git
cd chato
# install dependencies:
pnpm install
# build app backend:
pnpm build:app
# build ui:
pnpm build:ui
# start app:
pnpm app

• Build Tools for Visual Studio 2022
  • Select "Desktop development with C++"
  • Install the MSVC v143 and the Windows 11 SDK
• CUDA Toolkit 12.3

Copy all files from:

C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.3\extras\visual_studio_integration\MSBuildExtensions

into:

C:\Program Files (x86)\Microsoft Visual Studio\2022\BuildTools\MSBuild\Microsoft\VC\v170\BuildCustomizations

(The paths may vary depending on your installation/version)

# recompile node-llama-cpp with CUDA support:
pnpm cuda