Convert test harness into a series of unit tests about avim HOT 4 OPEN

• Build test harness
• Load FVDP tests
• Devise tests for past bugs and regressions
• Devise tests for bugs filed against other IMEs
• Remove old UI-based test harness
• Unit tests for ckSpell()
• Fuzzing?

from avim.

Travis now runs all the unit tests, including the entire FVDP corpus, on each push. These tests only exercise the transformer; we’re lacking coverage of the overlay and frame scripts. To test those, we’ll need some way of installing the extension into Firefox via the command line, and we’ll need some way to send keypress events to Firefox (headless testing?).

from avim.

I found Browserify can simulate a browser in command line: http://www.rexfeng.com/blog/2014/07/how-to-unit-test-your-js-and-use-it-in-the-browser/

Hope this help

from avim.

Thanks for the tip. Browserify is good for automated testing of a webpage in a browser environment. Travis already tests the only script that can be embedded in a webpage – transformer.js – in the exact same JavaScript environment as Firefox. What I'm mainly interested in is ensuring that the non-webpage parts – the extension itself – get testing.

Now that I've removed the old test harness from the bootstrapped branch, the outstanding task is to get Travis to run its built-in headless Firefox installation with a profile that includes AVIM. Perhaps node.js would be handy for processing a Web form that accepts input from this headless Firefox and relays it to the test harness.

The main benefit of such a setup would be that we would know immediately when Firefox removes a low-level API (#125) or a WYSIWYG editor library like Ace changes its API. Unfortunately, the most fragile part of AVIM historically has been support for Web apps like Google Docs and iCloud, where we rely on internal routines or IDs that could change without notice. These apps require accounts; I suspect it might not be kosher to set up an iCloud account essentially for automated testing of itself.

from avim.