Index build error: `invalid memory alloc request size` >= 1GB about pgvector HOT 3 CLOSED

Hey @ArthurMelin, thanks for reporting, and sorry you keep running into bugs. Fixed in the commit above. Will spin up a server with the max number of dimensions and lists to try and find any other issues.

from pgvector.

We have the same problem in version 0.5.0 with the new HNSW indexing.

CREATE INDEX idx_embedding_features ON mytable USING hnsw (embedding_features vector_l2_ops);

ERROR:  invalid memory alloc request size 1073741824"

Creating index after the table is loaded with 123,313,896 8-d vectors.

from pgvector.

Hi @lukeforehand, thanks for reporting. Pushed a fix in the commit above (it looks like Postgres lists only support 2^26 - 1 elements on 64-bit architectures).

from pgvector.