Include journey test in CI build to ensure clients can fetch and build exercises about java HOT 9 CLOSED

At this point, we've met the spirit of this story.

from java.

As a matter of update, this group has nearly finished this work. It's functional on a fork, but needs just a few nips-and-tucks to make it merge-worthy.

from java.

+1000

But... it requires a ruby install? How so?

It seems like it should be enough to download and unpack the linux version of the exercism binary, and then loop through each exercise in the config.json and say exercism fetch java SLUG, no?

The default is to use http://x.exercism.io, and you can fetch individual exercises without having an API key.

from java.

Well, but that setup would be using the deployed set of problems. This would be an attempt to catch defects introduced in the latest commit to the track.

That said, today the client doesn't filter much (just paths with the work "example" in them). Is that something that's likely to change in the near/mid future?

Perhaps it would be better to simply build each exercise individually (disconnected from their parent); that would have caught this issue.

from java.

... looking at the next layer of this onion, "success" would be a little hard to detect: some exercises, when fetched correctly do not compile (because we stop providing a shell of a solution, altogether a few steps down the progression).

I'll be chewing on this.

from java.

How about...

• copy the individual exercise
• rename/move example solution
• build

?

from java.

Picking this up as a morning exercise with a couple of folks from work (started with @bronhuston).

The basic plan is to replay the sandbox workstation setup in Travis, fetch, "solve" (copying the example), and test all problems. Not only does this check the validity of the test+example combination, but the plumbing too. When in place, committers have the luxury of focusing on the quality of the submission and not worry whether merging in will break production.

from java.

Ooops! Forgot to update the README.md accordingly... almost done. ;)

from java.

Okay; docs in place. Done.

from java.