[tor-bugs] #33076 [Metrics/Analysis]: Graph onionperf and consensus information from Rob's experiments

[Tor Bug Tracker & Wiki]

#33076: Graph onionperf and consensus information from Rob's experiments
-----------------------------------------+--------------------------------
 Reporter:  mikeperry                    |          Owner:  metrics-team
     Type:  task                         |         Status:  needs_revision
 Priority:  Medium                       |      Milestone:
Component:  Metrics/Analysis             |        Version:
 Severity:  Normal                       |     Resolution:
 Keywords:  metrics-team-roadmap-2020Q1  |  Actual Points:
Parent ID:                               |         Points:
 Reviewer:                               |        Sponsor:
-----------------------------------------+--------------------------------

Comment (by mikeperry):

 Ok I went and dug through the Tor and TorFlow source. For CDF-Relay-
 Stream-Capacity, we actually need:

 {{{
   plot -> 1000*measured/min(rate, observed)
 }}}

 As min(rate,observed) is what TorFlow uses to multiply out the measured bw
 weights. It does not include the middle "burst" value in this minimum.

 For CDF−Relay−Utilization, we def want:
 {{{
  read_write := (read + written) / 2;
  peak := observed
  plot -> read_write / peak
 }}}

 > I recall the peak advertised bandwidth thing we talked about in
 Whistler. It's significantly harder to compute than the current advertised
 (or observed) bandwidth, because we need to include lots of descriptors
 for that. We should pick a formula that we use for all experiments, not
 just for this one. Maybe we can start with the single value and leave it
 as a possible extension for the future to consider a moving window of 30
 days.

 Yeah.. so we really need this 30 day peak of the observed value, as that
 gets us closer to the true network capacity and utilization. Rob's
 experiment is useful exactly because it forces relays closer to their peak
 capacity. Long term, I think metrics should be computing these 30 day
 maxes continually and providing them as an auxillary csv or other data
 stream for graphs like these.

 For this experiment, it is interesting to see the direct change from 5 day
 peak observed to Rob's new values, but if I had to pick only one graph, I
 would still prefer using 30 day peaks.

--
Ticket URL: <https://trac.torproject.org/projects/tor/ticket/33076#comment:11>
Tor Bug Tracker & Wiki <https://trac.torproject.org/>
The Tor Project: anonymity online