Git Product home page Git Product logo

Comments (25)

ActiveConclusion avatar ActiveConclusion commented on May 21, 2024 1

Thank you, I am holding on and I am sure that we'll win this war. I can update the data during breaks between bombardments. But also I think it will be a good idea to provide instructions/accesses for someone else for updating the data. Volunteers are welcome.

Glory to Ukraine! Glory to Heroes!

from covid19_mobility.

ActiveConclusion avatar ActiveConclusion commented on May 21, 2024 1

Thanks, I am fine. Good, I will post instructions as soon as I can. Checked for updates, but it seems that Waze didn't update the data on their source https://datastudio.google.com/reporting/fe8a3c7d-9303-4e70-8acb-4e042714fa76/page/bhuOB

from covid19_mobility.

ActiveConclusion avatar ActiveConclusion commented on May 21, 2024 1

@Tomkernow Sent again

from covid19_mobility.

ActiveConclusion avatar ActiveConclusion commented on May 21, 2024

Hi @Tomkernow!
Thank you for reporting the issue. Probably it's an issue with the Waze scraper https://github.com/ActiveConclusion/waze_mobility_scraper
I wanted to refactor this scraper from a selenium solution to a few simple POST requests, however, I don't have so much time lately :( I will try to fix it as soon as I can.
Contributions are welcome.

from covid19_mobility.

Tomkernow avatar Tomkernow commented on May 21, 2024

Hi!

Thanks for your quick response.
I would love to hlep but do not have the quant skills to be of much use....
Do you think you will have time to fix it by the end of the week? If not, I can ask around for some help.

Best regards

from covid19_mobility.

ActiveConclusion avatar ActiveConclusion commented on May 21, 2024

If everything in Ukraine will be fine this week and I will be alive (I hope for that 😬), I will try to fix it by the end of the week. I will inform you about the progress here.

from covid19_mobility.

ActiveConclusion avatar ActiveConclusion commented on May 21, 2024

Manually updated on 15.02.22

from covid19_mobility.

Tomkernow avatar Tomkernow commented on May 21, 2024

I appreciate you taking the time to update the values! Big help!
I hope you stay safe and well....

from covid19_mobility.

ActiveConclusion avatar ActiveConclusion commented on May 21, 2024

Manually updated 18.02.22

from covid19_mobility.

oleh-kulik avatar oleh-kulik commented on May 21, 2024

I need more time to investigate how to rework scraper. I will update data manually at the moment.

from covid19_mobility.

ActiveConclusion avatar ActiveConclusion commented on May 21, 2024

Manually updated 22.02.22 (twosday)

from covid19_mobility.

Tomkernow avatar Tomkernow commented on May 21, 2024

Thanks a lot for updating everything manually! Please continue to do so if possible......
Hope you are staying safe!

from covid19_mobility.

Tomkernow avatar Tomkernow commented on May 21, 2024

Hi. Hope all is okay on your side.... Can you update the data? Instructions for the update are welcome - please post them here when possible - I can give it a go.
Cheers!

from covid19_mobility.

Tomkernow avatar Tomkernow commented on May 21, 2024

Hi! I have contacted Waze and they have updated their data

from covid19_mobility.

ActiveConclusion avatar ActiveConclusion commented on May 21, 2024

Hi! Yes, I saw that, I updated the data yesterday.
So I am posting instructions here on how to update the data manually.

  1. Open Waze dashboard. https://datastudio.google.com/reporting/fe8a3c7d-9303-4e70-8acb-4e042714fa76/page/bhuOB
  2. Select in filter all countries/cities
    image
  3. Click on three dots -> Export
    image
  4. Input the name of the file. For country-level data it should be "Waze_Country-Level_Data", for city-level - "Waze_City-Level_Data"
  5. Export files.
    If you have enough raw data files, then you are done 😃 But if you want merged and preprocessed data like in this repo, you should do the following steps.
  6. Open repo for Waze mobility scraper. https://github.com/ActiveConclusion/waze_mobility_scraper
  7. Upload these files. I will give you access to this repo.
    image
    image
  8. The data will be updated here in a few hours. https://github.com/ActiveConclusion/COVID19_mobility/tree/master/waze_reports. Every 3 hours there is a job here that automatically updates the data. https://github.com/ActiveConclusion/COVID19_mobility/actions

If you have any questions, feel free to ask 😃

Thank you!

from covid19_mobility.

ActiveConclusion avatar ActiveConclusion commented on May 21, 2024

Manually updated 12.03.22

from covid19_mobility.

ActiveConclusion avatar ActiveConclusion commented on May 21, 2024

Manually updated 21.03.22
P.S. Shopping mall in Kyiv before and after russian demilitarisation 😡
Kyiv

from covid19_mobility.

Tomkernow avatar Tomkernow commented on May 21, 2024

Damn that's absolutely crazy....

from covid19_mobility.

Tomkernow avatar Tomkernow commented on May 21, 2024

I don't think I have access to the repo in order to update files manually

from covid19_mobility.

ActiveConclusion avatar ActiveConclusion commented on May 21, 2024

Hi @Tomkernow! I sent you an invite to the repo: https://github.com/ActiveConclusion/waze_mobility_scraper
You should accept it here:
github-invite
Please let me know if you will have any other issues.
Thank you!

from covid19_mobility.

Tomkernow avatar Tomkernow commented on May 21, 2024

Ah... it has expired. Please send again if possible

from covid19_mobility.

ActiveConclusion avatar ActiveConclusion commented on May 21, 2024

Manually updated 29.03.22

from covid19_mobility.

Tomkernow avatar Tomkernow commented on May 21, 2024

CHEERS - please make sure is is updated again.
If possible, please post instruction on how to write new code to automise this.

from covid19_mobility.

ActiveConclusion avatar ActiveConclusion commented on May 21, 2024

Implemented a draft version of the new scraper. Testing results.

from covid19_mobility.

ActiveConclusion avatar ActiveConclusion commented on May 21, 2024

Successfully updated with scraper 11.04. Closing this issue. Will reopen if needed.

from covid19_mobility.

Related Issues (20)

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.