[tor-bugs] #28061 [Core Tor/sbws]: Check prioritisation, it should make 2 measurements that are 24 appart

[Tor Bug Tracker & Wiki]

#28061: Check prioritisation, it should make 2 measurements that are 24 appart
---------------------------+-------------------------------------
 Reporter:  juga           |          Owner:  (none)
     Type:  defect         |         Status:  new
 Priority:  Medium         |      Milestone:  sbws 1.0 (MVP nice)
Component:  Core Tor/sbws  |        Version:
 Severity:  Normal         |     Resolution:
 Keywords:                 |  Actual Points:
Parent ID:  #28042         |         Points:
 Reviewer:                 |        Sponsor:
---------------------------+-------------------------------------

Comment (by juga):

 Replying to [comment:4 teor]:
 > I am very confused by these results. It seems strange to me that sbws
 can't make 2 measurements of a relay over a few days.

 It also seems weird to me, so that i've been debugging prioritization
 today, so far i didn't find the reason.

 > Can you please tell us:
 > * how long sbws has been running for?

 Forever :) Results dated older than 7 days ago are not took
 Those results were done without the last recent day, but still.

 > * the number of relays measured each day:

 This is the number of results each day, not relays:

 1555 2018-10-10.txt
 1485 2018-10-11.txt
 1363 2018-10-12.txt
 1574 2018-10-13.txt
 1665 2018-10-14.txt
 1707 2018-10-15.txt
 1819 2018-10-16.txt
 3332 2018-10-17.txt

 The 2018-10-16 around 14h i increased the number of threads, what does not
 seem to increase the speed too much, probably because of
 https://gitweb.torproject.org/sbws.git/tree/sbws/core/scanner.py#n358

 Today, around 14h, i have commented the rtt measurements. By the number of
 results in the file today, it seems faster now...
 I also noticed that today every prioritization loop (~300 relays) happens
 every ~45min. The days before, it was happening every 6h.
 I still don't understand why such a difference eliminating that code.

 With the data from today, now i get:
 - number of  successfully measured relays with the restriction: 1319
 - number of measured relays: 5933

 > * the exact code that you are using to do the "2 measurements at least
 24 hours apart" test?

 https://gitweb.torproject.org/sbws.git/tree/sbws/lib/v3bwfile.py#n278

 > * the exact measurement times for a relay that passes the test?

 Attachment

 > * the exact measurement times for a relay with multiple measurements
 that fails the test?

 Attachment
 All from today, hmm?

 * Today, number of relays with 1 result: 4610, with 2: 1308, with 3: 15

--
Ticket URL: <https://trac.torproject.org/projects/tor/ticket/28061#comment:6>
Tor Bug Tracker & Wiki <https://trac.torproject.org/>
The Tor Project: anonymity online