[tor-dev] Test coverage updates on 0.2.8, master vs 0.2.7

[Nick Mathewson]

Hi, all.

In our first stable 0.2.7 release (0.2.7.5), we had 39.5% line
coverage from our unit tests, and 66.1% from unit plus integration
tests.

In current 0.2.8, we have 46.8% from unit tests, and 69.7% from
integration tests.

In current master, we have 47.0% from unit tests, and 69.6% from
integration tests.

(All number as of a couple days ago on my linux desktop)

So far, so good.

Now, let's do a breakdown of the changes in UNIT TEST COVERAGE between
0.2.7 and 0.2.8 based on the cov-diff tool in scripts/test,

  git diff --stat tor-0.2.7.5 maint-0.2.8 src/{common,or} gives me:
      180 files changed, 9434 insertions(+), 3571 deletions(-)

  grep '^- *1' cov-diff-output | wc -l
  438 removed lines-with-coverage.

  grep '^- *#' cov-diff-output | wc -l
  4266 removed lines without coverage [*]

  grep '^+ *#' cov-diff-output | wc -l
  2367 insertions without coverage. [**]

  grep '^+ *1' cov-diff-output | wc -l
  5793 insertions WITH coverage.

 [*] Note that these could be either lines that we began to cover with
tests, OR lines that had no coverage which we removed, OR lines that
had no coverage which we edited.
 [**] Note that these could be either lines that we stopped covering
with tests, OR lines that we added without tests, OR untested lines
that we changed.

Now the changes in INTEGRATION TEST COVERAGE:
  1023 removed lines-with-coverage
  1896 removed lines-without-coverage
  1086 added lines without coverage.
  5289 added lines with coverage
(same disclaimers apply. Can we make cov-diff give even better results?)

And last, a breakdown of changes between 0.2.8 and master so far:

 58 files changed, 2110 insertions(+), 570 deletions(-)

UNIT TESTS:
   219 removed lines-with-coverage
   132 removed lines-without-coverage
   234 added lines without coverage.
   317 added lines with coverage

INTEGRATION TESTS:
   359 removed lines-with-coverage
   248 removed lines-without-coverage
   401 added lines without coverage.
   406 added lines with coverage

-- 
Nick