Git Product home page Git Product logo

ieturk's Introduction

IE-Turk: Annotation tool for Information Extraction with localturk / Amazon Mechanical Turk

Annotate

Annotate using Mechanical Turk

  • Create an new project in Amazon Mturk interface.
  • Paste the content of annotate.html in the second tab Design layout.
  • Insert the scripts config.js, annotate.js and the CSS file style.css into the document as well
  • Prepare a tokenized version of the entry, splitting characters with >>.
  • Submit batch

Annotate locally

Requires localturk. Install using

npm install -g localturk

Modify config.js with the name of the fields of interest. Then simply run it using the same tokenized csv file as for Mechanical Turk.

localturk annotation.html input.csv output.csv

Screenshot

Visualize

Simply open visualize.html with any modern browser. Then choose the .csv that came from either localturk or Mechanical Turk.

Screenshot

This file is also served at Visualization Demo. You can try uploading this CSV file.

ieturk's People

Contributors

nmstoker avatar varal7 avatar

Stargazers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

Watchers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

ieturk's Issues

Question: Use of ieturk within other crowdsourcing platforms

This text annotation tool is great and quite straightfoward to setup within Amazon Mechanical Turk. I am working on a research project where the use of a text annotation tool within the field of crowdsourcing can be used such that non-experts are able to label text from medical data.

Is the use of this software limited to only Amazon Mechanical Turk or can it be used in other crowdsourcing platforms? Of course some changes may need to be made when using the code on other platform but is this code disallowed from being used in other platforms such as figure eight?

Feature request: allow pre-existing annotation

Hi,

I have a feature request ---

Can the GUI pre-populate certain entities, if they are somehow encoded in the input text? This would support a scenario in which some entities can be pre-identified, but would still require confirmation from a human annotator.

E.g., In the example from ner.csv:

He>>said>>further>>scientific>>study>>was>>required>>and>>if>>it>>was>>found>>that>>action>>was>>needed>>it>>should>>be>>taken>>by>>the>>European>>Union>>.

Is there a way to encode in the input that "European Union" is a potential PLACE, and have that show up pre-populated in the UI? Then the annotators can confirm the annotation if it is correct, otherwise they can remove it or change it.

thanks.

MTurk error

When I paste the contents of annotation, config, annotate, style files in the Design Layout of MTurk, I get this error
Layout does not contain any fields that include a name attribute. Please include at least one field with the name attribute (input, select or textarea) that will appear in your results.

Does you code still work for Crowd HTML?

Hello,

Thank you so much for the tool. It seems to be exactly what I am trying to do. SageMaker's NER model is too expensive for my data size. I copy and paste the content of annotate.html in the second tab Design layout, but I feel it is no longer suitable to current Crowd HTML... I could be totally wrong. I am wondering if you can confirm your code would work in the same way 3 years ago, before I digging further. Thanks!

Ray

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.