Illegal instruction (core dumped) on Linux Virtual Machine (KVM) about gpt4all HOT 6 CLOSED

Same problem here, the exectution stops in the ggml_type_sizef function on the vxorps %xmm0,%xmm0,%xmm0 instruction. I suppose this is because I'm running this on a very low-end CPU which doesn't support the AVX(?) instructions. Perhaps this is a bug in the ggml library, in the code for differentiating CPU features.

from gpt4all.

@Netherdrake you need AVX support for this particular instruction. Then you need AVX2 too (see issue 82). Since your CPU supports it you need to somehow pass that too through your VM software.

from gpt4all.

@pepega007xd

Perhaps this is a bug in the ggml library, in the code for differentiating CPU features.

Looks like you are right. See my other reply. This code is basically "return true;". CPU features are decided in compile-time, and not run-time.

from gpt4all.

I have a similar issue in another project (privateGPT), and here is my solution as a reference.

My environment is CPU E5-2680v4 + PVE VM. The root case is application code cannot execute avx/avx2 instructions and crashes. We have two directions to deal with:

1. [Not lucky] If CPU does not support avx/avx2, then refer to https://tech.amikelive.com/node-887/how-to-resolve-error-illegal-instruction-core-dumped-when-running-import-tensorflow-in-a-python-program/
2. [Lucky] If CPU does support avx/avx2, but VM has no avx/avx2 flags, then simply pass avx/avx2 flags into VM.

My issue fits solution (2), and from the problem statement above, the CPU "AMD Epyc 7313" supports avx/avx2, the only issue is VM has no correct CPU flags, it could fit into solution (2). I don't know which VM provider you are using, may need to pass the flags accordingly.

• For KVM: https://superuser.com/questions/1467225/how-to-make-the-kvm-enable-cpu-flags-sse4-2-to-the-guest
• For PVE, simply change the processor type to host and restart VM, ref: https://forum.proxmox.com/threads/avx2-and-avx-flags-on-vm.87808/

Hope it helps a little.

from gpt4all.

anyone running vm on windows check this article out
https://stackoverflow.com/questions/65780506/how-to-enable-avx-avx2-in-virtualbox-6-1-16-with-ubuntu-20-04-64bit

from gpt4all.

Stale

from gpt4all.