Git Product home page Git Product logo

artificial-data-generator's Introduction

Artificial text data creation and annotation

Data generator

Randomly generates values for placeholders in text.

usage: data_generator.py [-h] -source SOURCE -output OUTPUT -names NAMES
                         -surnames SURNAMES -places PLACES [-keeptag]

Process data files.

optional arguments:
  -h, --help            show this help message and exit
  -source SOURCE, -s SOURCE
                        Source data file
  -output OUTPUT, -o OUTPUT
                        Modified data file
  -names NAMES, -n NAMES
                        Names file
  -surnames SURNAMES, -r SURNAMES
                        Surnames file
  -places PLACES, -p PLACES
                        Placenames file
  -keeptag, -t          Maintain tags in XML form

Sample usage for Kanuri

python data_generator.py -s in/kanuri-src.txt -o out/kanuri-tagreplaced.txt -n kanuri/kanuri_names.txt -r kanuri/kanuri_surnames.txt -p kanuri/kanuri_placenames.txt

Sample usage for Hausa

python data_generator.py -s in/hausa-src.txt -o out/hausa-tagreplaced.txt -n hausa/hausa_names.txt -r hausa/hausa_surnames.txt -p hausa/hausa_placenames.txt

Label studio annotation file creator

Creates a JSON format file to load in label studio. Places tags that are already there.

usage: annotation_to_json.py [-h] -i I [-o O]

Convert annotation to JSON.

optional arguments:
  -h, --help  show this help message and exit
  -i I        Input file
  -o O        Output file

Sample usage for Hausa

python annotation_to_json.py -i out/hausa-tagreplaced.txt -o out/hausa-labelstudio.json

Sample usage for Kanuri

python annotation_to_json.py -i out/kanuri-tagreplaced.txt -o out/kanuri-labelstudio.json

artificial-data-generator's People

Contributors

alpoktem avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.