Comments (4)
I think we initially considered up and down arrows, but decided against them because they were going to be used for setting hard constraints. If that is no longer the case then I wouldn't mind re-naming them and giving them different icons.
from openreview-matcher.
At one point I thought that up/down arrows might be a better way to move reviewers from the primary list to the alternate list or vice-versa but came to the conclusion that it didn't really matter that much because the representation of a primary list and alternate list made it pretty clear to me what the impact of my actions was. It does not give the impression of "voting". When I see a reviewer move from primary list to the alternates list, this does not feel like a suggestion. It feels more like a command in that I have just edited the model and its reviewers lists now reflects that edit.
So if you are wanting to give an impression that a user is making suggestions through voting, I think more needs to change than the name we give to the buttons.
So I'm making some assumptions about how you might be envisioning this working in a multi-user situation (e.g. multiple PCs manipulating a single paper's reviewer list). Each up-vote would increase a reviewer's vote count and each down-vote would decrease it Would the primary list then contain those reviewers with the most votes and the alternates list shows those with less? Each list could be sorted by number of votes.
Going into the implementation a bit here: I think I'm also hearing you say that up/down votes might still work as a hard-constraint (which we currently achieve by using +inf/-inf as paper-user scores in the constraints list) but in the future it might be more of a vote tally. We'd then be able to make some changes to the algorithm to use these votes in a different way than we use hard constraints.
If I'm on the mark with this, we might then need some UI control other than voting if a PC really wants to veto or lock a reviewer rather than vote!
from openreview-matcher.
We decided to try out using a green plus and a red minus for the buttons.
from openreview-matcher.
Outdated
from openreview-matcher.
Related Issues (20)
- ECCV Feedback
- Support different demands per paper
- Integrate PeerReview4All
- Implement 'soft' constraints
- Support python function as a score specification HOT 1
- Catch group not found error HOT 3
- No solution error: show a more descriptive message in the UI HOT 2
- FairFlow: Catch assert failures and set an error status in the configuration
- Run each matching configuration using a queue
- Clean `error_message` value if the matching has completed succesfully HOT 3
- Catch exception when there are no submissions or reviewers HOT 1
- OpenReview Interface: only take in account the tilde ids members of the match_group HOT 2
- Deploy matching API in the dev server after PRs are merged into master
- Deploy matching shouldn't validate if all the members of the group are tilde ids
- Move Tests Workflow from CircleCI to GitHub Actions
- Replace members with ids before validation if all the members of the group have a profile
- Allow to rerun the matcher after it has finished running
- Move group validation to be part of the async task
- Reset status of running tasks after the server is restarted
- Remove profile validation: all members of the group must have a profile HOT 5
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from openreview-matcher.