Comments (2)
@tdoehmen, thanks for sharing! I didn't know about simple-ddl-parser; it could be helpful. Yes, I consider the development/adaptation of the existing SQL parser. My goal is a bit different, I have huge SQL dumps sometimes and I would like to convert them to CSV/JSONl without an RDBMS instance and I am working on several cmd tools and data engineering projects with many SQL, CSV, and other data and schema file types.
But universal SQL and CSV parsers are a very interesting topic to me too. I will email you after some tests over the dataset of SQL files.
from gitschemas.
Hi Ivan,
glad to hear that you liked our work.
What I can share right now is a list of ~600k URLs that point to raw .SQL files on GitHub. I've uploaded it here.
We used pglast for parsing, which succeeded for about 15% of the files. A great project which recently helped us to achieve a ~50% success rate on the same corpus is simple-ddl-parser - it's worth having a look at this project if you haven't already.
Developing a more robust or universal CSV parser is certainly a very interesting topic. If you are interested to discuss this in more detail, feel free to reach out to me by email (t.r.dohmen at uva.nl).
Best,
Till
from gitschemas.
Related Issues (1)
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from gitschemas.