[metrics-bugs] #28137 [Metrics/Statistics]: Modify "Total consensus weights across bandwidth authorities" graph to only include relays that end up in the consensus

[Tor Bug Tracker & Wiki]

#28137: Modify "Total consensus weights across bandwidth authorities" graph to only
include relays that end up in the consensus
--------------------------------+------------------------------
 Reporter:  karsten             |          Owner:  metrics-team
     Type:  enhancement         |         Status:  new
 Priority:  Medium              |      Milestone:
Component:  Metrics/Statistics  |        Version:
 Severity:  Normal              |     Resolution:
 Keywords:                      |  Actual Points:
Parent ID:                      |         Points:
 Reviewer:                      |        Sponsor:
--------------------------------+------------------------------

Comment (by karsten):

 Alright, I implemented the idea above.

 However, it turns out that matching all vote entries with all consensus
 entries ''cannot'' be done with reasonable effort, at least not with the
 current tools we use. For example, processing 3 days of descriptors takes
 quite reasonable 5 minutes, but processing 3 weeks of descriptors already
 takes almost 3 hours. This simply doesn't scale to 3 months or 3 years.

 We do have these 3 weeks from my tests though, so let's look at the
 results:

 [[Image(totalcw-2018-11-22.png​, 500px)]]

 The red line is what's currently on the Tor Metrics website: it contains
 measured bandwidths of all relays in a vote, regardless of whether a relay
 made it into the consensus. The blue line only contains those relays in a
 vote that also appeared in the consensus. I'd say that the difference is
 almost negligible.

 What I'd like to try out is add a third line "Running in vote", which
 would at least kick out relays in a vote that the authority didn't find to
 be running. I'd expect that line to show up between red and blue. However,
 a relay that doesn't have the Running flag in one vote can still go into
 the consensus if the others think it's running. And a relay that has the
 Running flag from one authority can still not show up in the consensus if
 the others disagree. So, I'm unclear whether this really helps. Worth
 trying, and a much smaller change, because it doesn't require us to match
 vote entries with consensus entries.

--
Ticket URL: <https://trac.torproject.org/projects/tor/ticket/28137#comment:5>
Tor Bug Tracker & Wiki <https://trac.torproject.org/>
The Tor Project: anonymity online