Comments (4)
vukosim
commented on May 22, 2024
@cishiv also some errors in parsing NICD. See
for
http://www.nicd.ac.za/covid-19-update-21/
we get
9-03-2020,20200319,South Africa,LIM,ZA-LIM,56,female,Travelled to France
but it is supposed to be
Mpumalanga, not limpopo
from covid19za.
vukosim
commented on May 22, 2024
Also for limpopo
it shoudl be ZA-LP and LP not LIM
as per https://en.wikipedia.org/wiki/ISO_3166-2:ZA
from covid19za.
cishiv
commented on May 22, 2024
Will look at this. Thanks @vukosim
from covid19za.
cishiv
commented on May 22, 2024
@vukosim resolved #79
nicd started including 'x' as a placeholder for years old, this broke the scraper.
I have also complied with https://en.wikipedia.org/wiki/ISO_3166-2:ZA in terms of provice naming
shiv@LAPTOP-ENNNEGDS:~/dev/projects/covid19za/scraper$ ./scraper nicd
[WARNING] Please note that media statements prior to (16-03-2020) may not be parseable due to inconsistent html formatting
[INFO] Selected nicd
[INFO] OPTIONS (select one)
--------------------------------------------
1 http://www.nicd.ac.za/covid-19-update-24/
2 http://www.nicd.ac.za/covid-19-update-23/
3 http://www.nicd.ac.za/covid-19-update-22/
4 http://www.nicd.ac.za/covid-19-update-21/
5 http://www.nicd.ac.za/covid-19-update-20/
6 http://www.nicd.ac.za/covid-19-update-19/
7 http://www.nicd.ac.za/covid-19-update-18/
8 http://www.nicd.ac.za/covid-19-update-17/
9 http://www.nicd.ac.za/covid-19-update-16/
10 http://www.nicd.ac.za/covid-19-update-15/
2
Eastern Cape Province
Gauteng Province
KwaZulu-Natal Province
Western Cape Province
[INFO] OUTPUT
----------------------------------
403,21-03-2020,20200321,South Africa,EC,ZA-EC,28,female,Travelled to Germany
404,21-03-2020,20200321,South Africa,GP,ZA-GP,x,male,Travelled to France
405,21-03-2020,20200321,South Africa,GP,ZA-GP,55,male,with pending travel history
406,21-03-2020,20200321,South Africa,GP,ZA-GP,26,male,with pending travel history
407,21-03-2020,20200321,South Africa,GP,ZA-GP,34,female,with pending travel history
408,21-03-2020,20200321,South Africa,GP,ZA-GP,43,female,with pending travel history
409,21-03-2020,20200321,South Africa,GP,ZA-GP,61,male,with pending travel history
410,21-03-2020,20200321,South Africa,GP,ZA-GP,6,female,with pending travel history
411,21-03-2020,20200321,South Africa,GP,ZA-GP,29,female,with pending travel history
412,21-03-2020,20200321,South Africa,GP,ZA-GP,45,female,with pending travel history
413,21-03-2020,20200321,South Africa,GP,ZA-GP,64,female,with pending travel history
414,21-03-2020,20200321,South Africa,GP,ZA-GP,67,male,Travelled to France and Ethiopia
415,21-03-2020,20200321,South Africa,GP,ZA-GP,39,male,Travelled to the United Kingdom
416,21-03-2020,20200321,South Africa,GP,ZA-GP,72,female,Travelled to Belgium and the Netherlands
417,21-03-2020,20200321,South Africa,GP,ZA-GP,41,male,Travelled to France and Italy
418,21-03-2020,20200321,South Africa,GP,ZA-GP,37,female,with pending travel history
419,21-03-2020,20200321,South Africa,GP,ZA-GP,30,female,Travelled to the United Kingdom and the Netherlands
420,21-03-2020,20200321,South Africa,KZN,ZA-KZN,59,male,with pending travel history
421,21-03-2020,20200321,South Africa,KZN,ZA-KZN,68,male,with pending travel history
422,21-03-2020,20200321,South Africa,KZN,ZA-KZN,26,female,Travelled to the United States of America and the United Kingdom
423,21-03-2020,20200321,South Africa,WC,ZA-WC,30,female,Travelled to Ireland
424,21-03-2020,20200321,South Africa,WC,ZA-WC,57,female,Travelled to Germany and Switzerland
425,21-03-2020,20200321,South Africa,WC,ZA-WC,55,not specified,Travelled to France and Switzerland
426,21-03-2020,20200321,South Africa,WC,ZA-WC,74,female,Travelled to the United Kingdom
427,21-03-2020,20200321,South Africa,WC,ZA-WC,52,male,with pending travel history
428,21-03-2020,20200321,South Africa,WC,ZA-WC,44,male,Travelled to the United States of America
429,21-03-2020,20200321,South Africa,WC,ZA-WC,26,female,Travelled to the United Kingdom
430,21-03-2020,20200321,South Africa,WC,ZA-WC,57,male,Travelled to Spain
431,21-03-2020,20200321,South Africa,WC,ZA-WC,36,male,Travelled the United Kingdom and France
432,21-03-2020,20200321,South Africa,WC,ZA-WC,40,female,with pending travel history
433,21-03-2020,20200321,South Africa,WC,ZA-WC,52,female,Travelled to the United Kingdom
434,21-03-2020,20200321,South Africa,WC,ZA-WC,48,female,Travelled to the United Kingdom
435,21-03-2020,20200321,South Africa,WC,ZA-WC,39,male,Travelled to Dublin and Ireland
436,21-03-2020,20200321,South Africa,WC,ZA-WC,36,male,with pending travel history
437,21-03-2020,20200321,South Africa,WC,ZA-WC,55,female,with pending travel history
438,21-03-2020,20200321,South Africa,WC,ZA-WC,45,male,Travelled to Germany and Austria
439,21-03-2020,20200321,South Africa,WC,ZA-WC,65,female,Travelled to the United Kingdom
440,21-03-2020,20200321,South Africa,WC,ZA-WC,34,male,with pending travel history
from covid19za.
Related Issues (20)
- [Feature] Showcase Section in README - Urls changed for demo and repo for 'Covid-19 SA Data' project. HOT 4
- [Feature] Capture Vaccination Figures HOT 6
- [DATA] Extra comma in file covid19za_timeline_testing.csv HOT 1
- [DATA] provincial_gp_cumulative.csv - "date" column error HOT 1
- [Feature] FYI added tracking for Phase 2 Vaccinations HOT 3
- [DATA] Duplicate data on 24 and 25 May 2021 HOT 2
- gis_nicd_scraper HOT 24
- [DATA]Data Sources: NICD - South Africa URL error
- [Feature] Pull SAHPRA Adverse events following immunisation (AEFI) for COVID-19 vaccines
- [BUG] Scraper workflow error HOT 1
- [BUG] Challenge with scraper (R) HOT 1
- [BUG] Run failed: Scrape provincial vaccinations data from sacoronavirus.co.za HOT 2
- [BUG] Vaccination data not updated HOT 2
- [DATA] Blip in the data HOT 6
- [DATA] dsfsi covid data NICD scraper broken HOT 2
- [ENHANCE] [DATA] Update NICD Hospitalization Data HOT 13
- [Feature] Additional data sources HOT 2
- [DATA] HOT 1
- Op-Ed and Letter to the editor HOT 17
- Closing and Archiving the Project HOT 5
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from covid19za.