Comments (16)
We have a "hidden demo" available at http://demo.allennlp.org/wikitables-parser/MzAyNzMw.
@matt-gardner do you have any ideas for roughly how we could provide a better visualization here?
from allennlp-demo.
@matt-gardner is what's showing up in the "answer" box actually what you want to see for the answer? I'm a bit confused by the output.
from allennlp-demo.
Yeah, something about the executor broke in between when I originally wrote the demo and putting it in here. The answers are currently all wrong.
But, other than that, the content being shown in the demo is roughly the right thing to show, I think, it could just be presented in a nicer way. Not really sure on designs for how to make it look better, though.
from allennlp-demo.
Oh, another important issue: one of the inputs is a table. We're currently hacking something together to get a table input to the model, using a big text field, but if there were some nicer way of doing this, that'd be much better.
And one important use case that should still work with any redesign of the input is copying and pasting a table from this site: https://nlp.stanford.edu/software/sempre/wikitable/viewer/#203-35.
from allennlp-demo.
@matt-gardner thanks--that gives me enough to work on for now. Just wanted to know whether you had something particular and different in mind.
from allennlp-demo.
@matt-gardner @aaronsarnat and I are pretty unsure how to best visualize the logical forms coming out of the semantic parser. We would like to start by improving how they look and ignore the table input for now.
For reference, here's one output example that's also "formatted" by me (potentially incorrectly).
((reverse fb:cell.cell.date) ((reverse fb:row.row.season) (fb:row.row.position fb:cell.1st)))
(
(reverse fb:cell.cell.date)
(
(reverse fb:row.row.season)
(fb:row.row.position fb:cell.1st)
)
)
One question we had was whether hierplane could visualize this. It's pitch is that it can visualize any tree structure, but I'm not sure this is the best fit. If it is, that would be a fast first pass however.
Do you have some time to follow up with Aaron? I'm happy to join if it would be helpful.
from allennlp-demo.
Honestly, I'm a lot more concerned about the action outputs and the attention visualizations than I am about the logical form. I'm not really sure there's anything that can be done to make the logical form better. It's basically just a block of code in some language. Maybe you could add some syntax highlighting for the language it's in? This is one lisp (and two others that are coming will also be lisp), we have some (and eventually more) that is SQL.
from allennlp-demo.
@matt-gardner I think syntax highlighting, formatting, and maybe mouseovers would go a long way. When I look at the overall output I fixate on how I simply do not understand what's there at all.
What do you mean by "action output"?
Aaron has ideas for how to improve the attention visualization already.
from allennlp-demo.
If you want to do code formatting on this, I'd be sure to do it in a common lisp style (e.g., http://lisp-lang.org/style-guide/#indentation).
from allennlp-demo.
Re: lisp style--of course.
What tooltips would you have over "reverse" and "fb"?
from allennlp-demo.
@matt-gardner what's an overall good reference for the output language--http://ai2-website.s3.amazonaws.com/publications/wikitables.pdf?
from allennlp-demo.
The language is going to be domain-specific and not worth the work to specialize for every demo individually. I'd probably instead have a caveat in the task description that the logical form takes some outside reading to understand.
from allennlp-demo.
Design update
@matt-gardner @schmmd please take a look at this and give me your thoughts.
Click the thumbnail to watch an interaction mockup video I created that hopefully demonstrates how I think an improved attention visualization would work:
Caveat: I haven't scoped out the time and effort for actually building this yet. It would be a substantial amount of work, but I think it could be chunked out into smaller pieces, and rolled out according to priority.
The main feedback I'm looking for now is: is this what we actually want? If so, this could be our aspirational design that perhaps we make incremental progress towards and course correct along the way if need be...
from allennlp-demo.
Yes, I think that looks great!
from allennlp-demo.
Thanks @matt-gardner! You mentioned via slack that there probably isn't much value in surfacing the normalization type to the user in the data grid tooltips, so I won't worry about that detail for now.
Let me know if you guys have any other critical feedback about the design. In the meantime, I'll be working on scoping this out and identifying logical chunks we could roll out in a series of successive PRs.
from allennlp-demo.
Closing, as this issue is now being tracked in the following issues:
- Show crosshairs when hovering HeatMap (#96)
- Add custom tooltip for displaying HeatMap cell values (#97)
- Refactor
<Pane />
(#88) - Replace nested Accordion UX with Drawer system (#89)
- Make HeatMap table headings "sticky" on scroll (#94)
- Add angled column labels to HeatMap (#95)
from allennlp-demo.
Related Issues (20)
- Textual Entailment model is broken due to a javascript error HOT 1
- Payload too large error (http 413) when submitting the VQA demo. HOT 5
- Unexpected token < in JSON at position 0 HOT 5
- In house SEQ explorer application/website
- [Constituency Parsing] Long sentences aren't properly rendered in screen HOT 1
- The demo deploy doesn't work. HOT 2
- Adding a pretrained model outside of AllenNLP to the AllenNLP_demo HOT 1
- New to AllenNLP. Trying to start the Demo. HOT 4
- Emphasize that the AllenNLP library is losing support in December on allenai.org/allennlp. HOT 7
- Error when starting bidaf
- text-to-sql demo is no longer available
- TaskDemo should simply by named "Demo"
- Modify the API endpoints so that they all get their own certificate.
- README.md header doesn't show well in dark mode
- Rename main branch to "main"
- Selecting a model doesn't work anymore. HOT 1
- The demo script isn't working anymore.
- Add SmBoP to demo HOT 3
- Update Sentry and Filter Spurious Errors HOT 2
- NPM Security Alerts: Patch AllenNLP Demo
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from allennlp-demo.