heycarsten / lcbo-api Goto Github PK
View Code? Open in Web Editor NEWA crawler and API server for Liquor Control Board of Ontario retail data
Home Page: https://lcboapi.com
License: GNU General Public License v3.0
A crawler and API server for Liquor Control Board of Ontario retail data
Home Page: https://lcboapi.com
License: GNU General Public License v3.0
Would be nice to set up continuous integration for LCBO API. It will also make for an easier time bringing on new maintainers. CI is great, CircleCI is free for open source projects, LCBO API should use it π
Explore ideas related to growing project beyond the scope of just LCBO data: https://github.com/heycarsten/lcbo-api/blob/master/doc/lcboapi-proposed.md
Part of this would likely be renaming the project to reflect this grander scope.
Hi, I'd like to know what the manager app does or was intended to do, its features, and etc. I tried following your instructions to run it, but it does not work - probably because it is outdated. Leaving the errors here, just in case anything can be done. Thanks!
npm install does not build properly:
WARN invalid config loglevel="notice"
Can not download file from https://raw.githubusercontent.com/sass/node-sass-binaries/v2.1.1/win32-x64-node-10.15/binding.node
[email protected] postinstall C:\Users\zeesh\OneDrive\Desktop\Gettit\manager\node_modules\node-sass
node scripts/build.js
internal/modules/cjs/loader.js:583
throw err;
^
Error: Cannot find module 'C:\Users\zeesh\OneDrive\Desktop\Gettit\manager\node_modules\node-sass\node_modules\pangyp\bin\node-gyp'
at Function.Module._resolveFilename (internal/modules/cjs/loader.js:581:15)
at Function.Module._load (internal/modules/cjs/loader.js:507:25)
at Function.Module.runMain (internal/modules/cjs/loader.js:742:12)
at startup (internal/bootstrap/node.js:283:19)
at bootstrapNodeJSCore (internal/bootstrap/node.js:743:3)
Build failed
npm notice created a lockfile as package-lock.json. You should commit this file.
npm WARN [email protected] had bundled packages that do not match the required version(s). They have been replaced with non-bundled versions.
And then running ember server gives:
internal/modules/cjs/loader.js:583
throw err;
^
Error: Cannot find module 'internal/util/types'
at Function.Module._resolveFilename (internal/modules/cjs/loader.js:581:15)
at Function.Module._load (internal/modules/cjs/loader.js:507:25)
at Module.require (internal/modules/cjs/loader.js:637:17)
at require (internal/modules/cjs/helpers.js:22:18)
at evalmachine.:44:31
at Object. (C:\Users\zeesh\OneDrive\Desktop\Gettit\manager\node_modules\ember-cli\node_modules\configstore\node_modules\graceful-fs\fs.js:11:1)
at Module._compile (internal/modules/cjs/loader.js:689:30)
at Object.Module._extensions..js (internal/modules/cjs/loader.js:700:10)
at Module.load (internal/modules/cjs/loader.js:599:32)
at tryModuleLoad (internal/modules/cjs/loader.js:538:12)
Product images urls are not working. (https://dx5vpyka4lqst.cloudfront.net/products/438457/images/thumb.png)
Error : dx5vpyka4lqst.cloudfront.netβs server IP address could not be found.
Users create API keys in order to gain access to LCBO API, this is a small step toward adding visibility to usage of the API. The API is targeted to be used server-side by web apps and backend apps. It's also intended to be used in the browser via CORS or JSON-P. Finally, it's intended to be used from
Keys have the following attributes:
Origin
header. Use these when accessing LCBO API from your own web-server or backend.Origin
header to be present and are tied to a domain. Use these when accessing LCBO API from a mobile phone app or browser-based JavaScript application.Auth Tokens have the following attributes:
I can't access https://s3.amazonaws.com/heycarsten/lcboapi-2018-12-17.tbz2 as linked in the Readme. Do I need to request credentials?
Hello, I am a computer programming student at Niagara. I have three weeks to build a mobile app. My proposed app intergrates the listing features of the LCBO and some of the basic social features of untappd in a simple way. Thus, a user could browse their local LCBO for beers and see at a glance which they have tried and which not, as well as the ratings from untappd, and possibly a detail page with more information. The user could make a wish list before they go to the lcbo if they want. My idea is to use barcodes initially to associate LCBO beers with their counterparts on untappd, a slightly inexact process as they don't have the same barcode databases, but good enough to be getting on with for my purposes.
If some one has a server running and would not mind generating me API keys for testing it would save me a lot of time. I have no plans to publish the app at this point and wouldn't share the keys.
Please drop me a note at [email protected] if you would be willing to help.
Thanks,
Erik
The dependencies are quite outdated
Yo, currently rate limiting works globally by IP or API Key, this was just a spike and is dumb, going forward rate limiting must meet the following requirements.
For V1 endpoints always rate limit by IP address to 300 requests per hour
hit_count
for the request's IP.max_hits_per_hour
, otherwise use the default for the given context.I think it's a bad idea if we all run the crawler for our own purposes, it will DDOS the lcbo website. I'm looking for people to collaborate with, to run one instance of the crawler and share the results. Ideas?
there is only a brief mention of the crawler but no instructions on how to run the crawler. if you could post the commands to run the crawler id be more then happy to update the read me with the information and a guide on how to use it.
I tried the tar xzf command recommended in the wiki.
I also tried recommendations from stack overflow
bzip2 -d lcboapi-2018-12-17.bz2
bzip2 -dk lcboapi-2018-12-17.bz2
bunzip2 lcboapi-2018-12-17.bz2
None of these worked either. They returned the error "bzip2: lcboapi-2018-12-17.bz2 is not a bzip2 file."
Hello!
Are the legacy datasets still available by chance? I'm specifically looking for the ones above 2451 so I can run some analysis on the last year's worth of data. I'd be happy to look into making new ones available if there's interest.
Thanks! Nice to see this project going open source!
LCBO API was approved for the Skylight open source program! π That means the power of Skylight for free!
I am trying to run the app following your instructions. Not sure if I am doing anything wrong, but Step 8/13 in docker-compose build returns multiple errors in fetching all the necessary files, and then finally returns:
E: Unable to fetch some archives, maybe run apt-get update or try with --fix-missing?
ERROR: Service 'app' failed to build: The command '/bin/sh -c DEBIAN_FRONTEND=noninteractive apt-get -yqq update && apt-get -yqq install software-properties-common
apt-transport-https build-essential git-core openssl libssl-dev acl zip pv postgresql-client-$POSTGRES_VERSION libpq-dev nodejs yarn' returned a non-zero code: 100
Maybe consider following the JSON-API spec.
Basically all the static view-layer shit should not be in the Rails app.
I was trying to see why this hasn't been updated since early 2019, and I found the answer on his Twitter account.
His wife posted his obituary: https://www.dignitymemorial.com/obituaries/dundas-on/carsten-nielsen-8730324
Hopefully someone can takeover the project and continue the great work that Carsten had been working on for over a decade!
Rest in peace, Carsten.
I've been reading Docker for Rails Developers on the recommendation of my friend and long time colleague Ben Moss, it's excellent and I see that I'm not doing things as well as I could around here, when I have time I'll update stuff with my new found knowledge
I always wanted to have both English and French Canadian versions of the content and docs on LCBO API, regrettably I'm not bilingual, anyways, if someone is curious to take this on hit me up βοΈ
Cannot render console from 172.18.0.1! Allowed networks: 127.0.0.1, ::1, 127.0.0.0/127.255.255.255
app_1 | (0.2ms) SELECT "schema_migrations"."version" FROM "schema_migrations" ORDER BY "schema_migrations"."version" ASC
app_1 | β³ /usr/local/bundle/gems/activerecord-5.2.2/lib/active_record/log_subscriber.rb:98
app_1 |
app_1 | ActiveRecord::PendingMigrationError (
app_1 |
app_1 | Migrations are pending. To resolve this issue, run:
app_1 |
app_1 | bin/rails db:migrate RAILS_ENV=development
app_1 |
app_1 | ):
Hello,
Please let me know how can i get API key. I am using he php wrapper for this.
A declarative, efficient, and flexible JavaScript library for building user interfaces.
π Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
The Web framework for perfectionists with deadlines.
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. πππ
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
We are working to build community through open source technology. NB: members must have two-factor auth.
Open source projects and samples from Microsoft.
Google β€οΈ Open Source for everyone.
Alibaba Open Source for everyone
Data-Driven Documents codes.
China tencent open source team.