[tor-bugs] #12243 [- Select a component]: Document running integration tests and link to their reports

[Tor Bug Tracker & Wiki]

#12243: Document running integration tests and link to their reports
----------------------------------+---------------------------------
 Reporter:  nathan-at-least       |          Owner:  nathan-at-least
     Type:  task                  |         Status:  new
 Priority:  normal                |      Milestone:
Component:  - Select a component  |        Version:
 Keywords:                        |  Actual Points:
Parent ID:                        |         Points:
----------------------------------+---------------------------------
 On a private Least Authority issue tracker, earthrise wrote:

 {{{
 Tasks:

 Try to run the integration tests with a PASS. Also note which unit tests
 fail.
 When running the tests by trial ooni after vagrant up, the
 test_oonibclient.py tests are skipped, because the backend isn't present.
 test_oonicli.py apparently passes, although I'm not sure which backend
 it's using. Answer: The HTTP header manipulation test is using the hard-
 coded http://64.9.225.221 test helper. The other tests don't need a
 backend (i.e. they hit websites on the internet or test against the
 8.8.8.8 DNS server). We should recommend that the http header test be run
 against a local copy of oonib, so that it tests the http header part of
 oonib as well.
 WARNING: Running vagrant up does NOT install your local copy of ooni-
 probe, it just installs the .deb file from their repository.
 Okay, I got most of them to pass! I had to install it myself in a Vagrant
 VM. I'll create a VagrantFile so that it can be reproduced. Some of the
 integration tests fail because the backend doesn't have the deck, nettest,
 etc.
 Find out if ooni/travis actually are running these tests.
 They are being run on travis-ci, although the test_oonibclient.py is being
 skipped (due to lack of bouncer).
 [ ] Figure out which decks and nettests the bouncer must have so that the
 integration tests pass. Then modify the Vagrantfile so they actually do
 pass. (Moved to #25).
 [ ] See if there is an easy way to separate coverage measurement for unit
 tests and integration tests. (Moved to #27).
 Add this information to assessment.rst.
 }}}

--
Ticket URL: <https://trac.torproject.org/projects/tor/ticket/12243>
Tor Bug Tracker & Wiki <https://trac.torproject.org/>
The Tor Project: anonymity online