Comments (2)
So this actually looks like it's behaving correctly. This is a new format for the Gradescope results introduced in v1.0.0 and is outlined here. Basically, there are 3 cases to consider:
- If a public test is failed, there is a single box for the test called
{test name} - Public
that displays the failed output of the test and is worth all of the points for that test. - If all public tests pass but a hidden test fails, there are two boxes: one called
{test name} - Public
that showsAll tests passed!
and a second called{test name} - Hidden
that shows the failed output of the test. The hidden test takes on all of the points for the test unless--public-multiplier
(orgenerate[public_multiplier]
in the case of Otter Assign) is passed to ensure that the scores add up correctly. - If all tests pass, there are two boxes,
{test name} - Public
and{test name} - Hidden
, that both showAll tests passed!
.
This is not the best solution but we couldn't think of one that met all of the requirements that we needed while displaying the information compactly. Please let me know if you can think of a better way.
from otter-grader.
I see, thanks for the explanation. The language hidden and public confused me since it appears to be used in different contexts, but I understand the intended use now. Thanks!
from otter-grader.
Related Issues (20)
- Migrate PDF via HTML exporter from wkhtmltopdf to nbconvert's webpdf exporter
- Enable PDF via HTML exports in grading containers
- Running the otter-grader tutorial HOT 4
- Convert python notebook to a python script file HOT 2
- Otter run --debug flag does not work
- Gradescope does tests in a different order than in the jupyter notebook HOT 2
- Otter Generate should deduplicate user-specified requirements with otter-provided ones
- Empty assignment config results in AttributeError
- Strip type annotations from generated test files in Otter Assign
- Add process for retrieving the executed notebook to docs
- Add metadata to last solution cell to run hidden test cases if question has no public tests
- Add manually graded questions within the same gradescope assignment
- Add Points Per Question and Total Points to final_grades.csv HOT 1
- Trying to implement a different container engine other than Docker, questions about image build HOT 1
- Otter-grader problems with juno app on ios HOT 4
- Cannot run grade HOT 4
- Incorrerct Grade HOT 11
- Plugins and submission_metadata HOT 2
- Otter Grade and Notebook Timeout
- Otter Grade: Write out Individual Results as well as final_grades.csv
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from otter-grader.