[tor-bugs] #29693 [Core Tor/Tor]: Decrease probability of stochastic failures in test-slow
Tor Bug Tracker & Wiki
blackhole at torproject.org
Fri Mar 8 09:33:55 UTC 2019
#29693: Decrease probability of stochastic failures in test-slow
-------------------------------+----------------------------------------
Reporter: teor | Owner: (none)
Type: defect | Status: new
Priority: High | Milestone: Tor: 0.4.0.x-final
Component: Core Tor/Tor | Version: Tor: 0.4.0.1-alpha
Severity: Normal | Keywords: tor-ci, tor-test, 040-must
Actual Points: | Parent ID:
Points: 0.5 | Reviewer:
Sponsor: Sponsor2-must |
-------------------------------+----------------------------------------
Our stochastic tests are supposed to fail around 1 in 100 runs. But when
I'm doing a backport to 0.2.9, there are up to 14 jobs times 9 branches,
each of which runs a test instance.
So let's decrease the probability to about 1 in (100 * 14 * 9).
Here's what the output looks like:
{{{
slow/prob_distr/stochastic_uniform: [forking] fail uniform sampler
FAIL src/test/test_prob_distr.c:1209: assert(ok)
NOTE: This is a stochastic test, and we expect it to fail from
time to time, with some low probability. If you see it fail more
than one trial in 100, though, please tell us.
Seed: 5DB9A3B32C29B76D7A0032700DD142BB
[stochastic_uniform FAILED]
}}}
https://travis-ci.org/torproject/tor/jobs/503432646#L5845
--
Ticket URL: <https://trac.torproject.org/projects/tor/ticket/29693>
Tor Bug Tracker & Wiki <https://trac.torproject.org/>
The Tor Project: anonymity online
More information about the tor-bugs
mailing list