Infer packaging from related products in the category about openfoodfacts-ai HOT 8 OPEN

@CloCkWeRX this is a topic I'd like to get moving asap, can you create a list of categories with strong correlations ?
and possibly for each category, an ordered list of frequency, possibly with the country (I think packaging sometimes changes from country to country)

from openfoodfacts-ai.

en:eggs
associated_packagings:en en:Cardboard to recycle

or perhaps easier, a collaborative spreadsheet that we can iterate on ?

from openfoodfacts-ai.

https://world.openfoodfacts.org/category/eggs/packaging

from openfoodfacts-ai.

Pipeline I'm setting up for this:

For each category
 data = fetch https://world.openfoodfacts.org/state/packaging-code-completed/category/(categoryname).json
 packaging = data.jsonpath('$.products..packaging_tags.*') # Produces something like below


 packaging_counts = {}
 packaging.each {|pkg| packaging_counts[pkg] += 1 }

which is a bit easier than doing it all manually.

What's best, ruby/python/perl/node; assuming this would run periodically?

from openfoodfacts-ai.

https://github.com/CloCkWeRX/openfoodfacts-packaging-from-category - python 2.7 version, simple command line tool that spits out JSON. It only goes into the first page of results right now.

from openfoodfacts-ai.

Okay, few more tweaks, handles pagination (stops after 3 pages), world or country, etc.

Now just need to generate the most popular categories and generate a bunch of static JSON :)

May need to let you specific "skip anything < X occurences" or "maximum products" as arguments.

from openfoodfacts-ai.

@raphael0202 - python isn't my default language, if you have some time would you mind looking over https://github.com/CloCkWeRX/openfoodfacts-packaging-from-category and suggesting if there are better or more idiomatic ways to structure this?

In my head, this is somewhat of a static JSON generator (just push all the results to git/easy to expose via a static web server for openfoodfacts-server to do browser queries to; or curl into elasticsearch); though could probably also publish things into an sqlite DB or other datastore (more like robotoff)

from openfoodfacts-ai.

@stephanegigandet

from openfoodfacts-ai.