[metrics-bugs] #33076 [Metrics/Analysis]: Graph onionperf and consensus information from Rob's experiments

[Tor Bug Tracker & Wiki]

#33076: Graph onionperf and consensus information from Rob's experiments
-------------------------------------------------+-------------------------
 Reporter:  mikeperry                            |          Owner:
                                                 |  metrics-team
     Type:  task                                 |         Status:
                                                 |  needs_review
 Priority:  Medium                               |      Milestone:
Component:  Metrics/Analysis                     |        Version:
 Severity:  Normal                               |     Resolution:
 Keywords:  metrics-team-roadmap-2020Q1, sbws-   |  Actual Points:  2
  roadmap                                        |
Parent ID:  #33121                               |         Points:
 Reviewer:                                       |        Sponsor:
-------------------------------------------------+-------------------------

Comment (by mikeperry):

 Gaba: This ticket is part of the work for Objective 3.1 of the MOSS
 proposal. I need tooling to produce graphs like this on a regular basis.
 We need them for the sbws transition eval (#33077). After that, we will
 need to set about turning these into scripts or metrics portal pages that
 can be used to produce this set of graphs on the regular.

 It might make more sense to make this ticket and #33077 child tickets of a
 ticket for Objective 3.1 rather than the sbws transition itself. Is there
 a ticket for Objective 3.1 yet?

 At a glance, the graphs we need are:
   1. onionperf-cdf-ttfb-2020-01-28a (CDF-TTFB and CDF-DL, with 95-100%
 tail zoom)
   2. cdf-relay-utilization-and-stream-capacity-2020-02-04 (CDF-Relay-
 Utilization and CDF-Relay-Stream-Capacity, plus votes)

 However, I am still puzzling out the differences when we used
 peak_observed (the 02-04 graphs) vs observed (01-29b graphs). I need to
 think on that a bit more and may have another graph request.

 For #33077, I think it would be helpful to group the votes in some way
 based on which dirauths are using sbws vs torflow. Not sure if that means
 overlay all the CDFs or just combine them, or do some additional work to
 take the median values of measured and min_rate_observed from each set and
 make one graph for TorFlow and one for sbws votes. On the one hand, we
 will want to pick an option that is likely to be useful for future
 experiments. On the other, we will need to really dig into what the
 network load balancing would look like under each system.

 So more iteration is needed.. Since that vote analysis is specific to sbws
 eval, that iteration can happen in #33077.

--
Ticket URL: <https://trac.torproject.org/projects/tor/ticket/33076#comment:19>
Tor Bug Tracker & Wiki <https://trac.torproject.org/>
The Tor Project: anonymity online