[tor-bugs] #18923 [Applications/Tor Browser]: Add a script in tor-browser.git to run all of our TBB-specific regression tests

[Tor Bug Tracker & Wiki]

#18923: Add a script in tor-browser.git to run all of our TBB-specific regression
tests
--------------------------------------+------------------------------
 Reporter:  arthuredelstein           |          Owner:  tbb-team
     Type:  enhancement               |         Status:  needs_review
 Priority:  Medium                    |      Milestone:
Component:  Applications/Tor Browser  |        Version:
 Severity:  Normal                    |     Resolution:
 Keywords:  TorBrowserTeam201607R     |  Actual Points:
Parent ID:                            |         Points:
 Reviewer:                            |        Sponsor:
--------------------------------------+------------------------------
Changes (by boklm):

 * status:  new => needs_review
 * keywords:   => TorBrowserTeam201607R
 * type:  defect => enhancement


Comment:

 I attached a new version of the patch.

 To avoid having to maintain a list of tests, it is now using all the test
 files added or modified by one of our commits (all the commits since the
 last `ffxbld` commit) matching `test_[^/]\+\.\(html\|xul\)$` or
 `browser_[^/]\+\.js$`.

 The tests that we want to ignore can be added to the file `tbb-tests-
 ignore.txt`.

 During our gitian build, we are removing the `.git` directory to save
 space needed for the build, so we don't have the git history available
 when we want to run the tests for #15994. If the `WRITE_TESTS_LIST`
 environment variable is set, the script will save the list of tests in the
 file `tbb-tests-list.txt` without running them, which will be used as the
 list of tests if the `USE_TESTS_LIST` environment variable is set. We can
 then run `WRITE_TESTS_LIST=1 ./run-tbb-tests` before removing the `.git`
 directory, and `USE_TESTS_LIST=1 ./run-tbb-tests` to run the tests after
 the build.

--
Ticket URL: <https://trac.torproject.org/projects/tor/ticket/18923#comment:6>
Tor Bug Tracker & Wiki <https://trac.torproject.org/>
The Tor Project: anonymity online