google / oculi Goto Github PK

Some cells in the third notebook (flattening, words, and performance) are failing and throwing not found errors.

E.g.
NotFound: 404 POST https://bigquery.googleapis.com/bigquery/v2/projects/[project_name]/datasets/test_ds_out/tables: Not found: Table [project_name]:test_ds_out.creative_sizes

It seems to be looking into the dataset created on the previous notebooks, so I'm unsure on whether it's failing to create them, or if my original datasets are incomplete. The first two notebooks threw no errors though.

Hello,

I came across this code and have been trying to implement it for creative analysis on a set of images.

When I run the pipeline, it works fine for a dataset of images that don't have faces in them. However, when the dataset has images with faces, the pipeline fails in Dataflow and the BQ output has all tables except face_annotations.

I'm not sure if this is an issue since Dataflow is deprecated for python 2 or an issue within the code itself. Has anyone else faced this issue?

Can somebody who has implemented this code help please? @ @xerebus @cdibona @dberlin @kalpanasuresh @sisrikshab

Thanks
-Abhi

Dataflow Screenshot -

Dataflow Errorlog Screenshot -

BQ Screenshot when pipeline ran successfully on set of images without faces

BQ Screenshot when pipeline failed on set of images with faces

Hi!

I see that Dataflow has deprecated Python2.7. Will Oculi still work on there? If not, is there a plan to upgrade this to Python3?

Thanks! Pelayo

Hi,
I tried to clone this repo and run the code with source=cm only in the sample.yaml file. I have given full admin rights to my email id for a Campaign Manager account but while running the script I am getting this error -

google.auth.exceptions.RefreshError: ('invalid_grant: Invalid grant: account not found', u'{"error":"invalid_grant","error_description":"Invalid grant: account not found"}'

It might be a dumb question but can you help me on what I might be doing wrong? I also did a fair bit of Google Search and found out that it might be due to expired token but I am not sure where to fix it. Can you help? @xerebus @cdibona @dberlin

When I ran the setup_environment.sh script most of it ran fine, but I did see a handful of errors:

ERROR: google-cloud-spanner 1.12.0 has requirement grpc-google-iam-v1<0.13dev,>=0.12.3, but you'll have grpc-google-iam-v1 0.11.4 which is incompatible.
ERROR: google-cloud-language 1.3.0 has requirement google-api-core[grpc]<2.0.0dev,>=1.14.0, but you'll have google-api-core 1.11.1 which is incompatible.
ERROR: google-cloud-translate 2.0.0 has requirement google-api-core[grpc]<2.0.0dev,>=1.14.0, but you'll have google-api-core 1.11.1 which is incompatible.
ERROR: google-cloud-translate 2.0.0 has requirement google-cloud-core<2.0dev,>=1.0.3, but you'll have google-cloud-core 1.0.1 which is incompatible.
ERROR: google-cloud-bigquery 1.6.2 has requirement google-cloud-core<0.30dev,>=0.28.0, but you'll have google-cloud-core 1.0.1 which is incompatible.
ERROR: tensorboard 2.0.1 has requirement grpcio>=1.24.3, but you'll have grpcio 1.21.1 which is incompatible.
ERROR: mssql-cli 0.17.0 has requirement prompt-toolkit<2.1.0,>=2.0.0, but you'll have prompt-toolkit 1.0.18 which is incompatible.
ERROR: mssql-cli 0.17.0 has requirement prompt-toolkit<2.1.0,>=2.0.0, but you'll have prompt-toolkit 1.0.18 which is incompatible.
ERROR: google-cloud-datastore 1.10.0 has requirement google-api-core[grpc]<2.0.0dev,>=1.14.0, but you'll have google-api-core 1.11.1 which is incompatible.
ERROR: google-cloud-datastore 1.10.0 has requirement google-cloud-core<2.0dev,>=1.0.3, but you'll have google-cloud-core 1.0.1 which is incompatible.
ERROR: google-cloud-logging 1.14.0 has requirement google-api-core[grpc]<2.0.0dev,>=1.14.0, but you'll have google-api-core 1.11.1 which is incompatible.
ERROR: google-cloud-logging 1.14.0 has requirement google-cloud-core<2.0dev,>=1.0.3, but you'll have google-cloud-core 1.0.1 which is incompatible.
ERROR: google-cloud-bigtable 0.31.1 has requirement google-cloud-core<0.29dev,>=0.28.0, but you'll have google-cloud-core 1.0.1 which is incompatible.

Some installs were done successfully and then one final error:

ERROR: Could not install packages due to an EnvironmentError: [Errno 13] Permission denied: '/usr/local/lib/python2.7/dist-packages/pbr-5.4.3.dist-info'
Consider using the --user option or check the permissions.

I do have a couple of new directories (jobs and pipeline), but I'm not sure whether these errors are showstoppers or just inconvenient. Also if there's any guidance on how to modify code or config docs to point to the correct libs, that would also be great.