Reading index datapoints within VPC network issue in Matching Engine about python-aiplatform HOT 7 CLOSED

It would be great to have this! It'll unblock some of our use cases that require item lookups (with Python API, on VPC)

from python-aiplatform.

+1 - the docs include an example of querying by document ID with the grpc cli, but the python client seems like it might be missing this.

from python-aiplatform.

Getting the same error just following the default Python example at https://cloud.google.com/vertex-ai/docs/vector-search/quickstart :

PROJECT_ID="my_project_id"
PROJECT_NUMBER="811111111111"
LOCATION="europe-west3"
INDEX_ENDPOINT_NAME="test-index-endpoint"
INDEX_ENDPOINT_ID="4444444444444444444"
DEPLOYED_INDEX_ID="my_deployed_test_index"

aiplatform.init(project=PROJECT_ID, location=LOCATION)

my_index_endpoint = aiplatform.MatchingEngineIndexEndpoint(
    index_endpoint_name = INDEX_ENDPOINT_ID,
    project = PROJECT_NUMBER,
    location = LOCATION
)


product_names = {}
product_embs = {}
with open('product-embs.json') as f:
    for l in f.readlines():
        p = json.loads(l)
        id = p['id']
        product_names[id] = p['name']
        product_embs[id] = p['embedding']

query_emb = product_embs['6523']

response = my_index_endpoint.find_neighbors(
    deployed_index_id = DEPLOYED_INDEX_ID,
    queries = [query_emb],
    num_neighbors = 10
)

for idx, neighbor in enumerate(response[0]):
    print(f"{neighbor.distance:.2f} {product_names[neighbor.id]}")

from python-aiplatform.

@matthewsparr is your workbench instance also within the same VPC?

from python-aiplatform.

@sshcherbakov The example works with a public endpoint, not with a VPC. We will add a note to the sample code.

from python-aiplatform.

+1

The query example page provided for a VPC endpoint context are using low level grpc calls: https://cloud.google.com/vertex-ai/docs/vector-search/query-index-vpc

The query example page for a public endpoint is using python:
https://cloud.google.com/vertex-ai/docs/vector-search/query-index-public-endpoint

Would someone have a working example in a VPC context in python in Cloud Run ?
We have tried to do it but could not achieve it so far.

from python-aiplatform.

read_index_datapoints() now support private service access endpoints, please update to or later https://pypi.org/project/google-cloud-aiplatform/1.38.0/.

from python-aiplatform.