[tor-bugs] #30735 [Core Tor/sbws]: Work out which relays are ignored by all sbws instances

[Tor Bug Tracker & Wiki]

#30735: Work out which relays are ignored by all sbws instances
-------------------------------------------------+-------------------------
 Reporter:  teor                                 |          Owner:  juga
     Type:  task                                 |         Status:  closed
 Priority:  Very High                            |      Milestone:  sbws:
                                                 |  1.1.x-final
Component:  Core Tor/sbws                        |        Version:
 Severity:  Critical                             |     Resolution:  fixed
 Keywords:  must-keep-3-torflow-blocker, sbws-   |  Actual Points:
  majority-blocker, sbws-roadmap                 |
Parent ID:  #33121                               |         Points:  6
 Reviewer:                                       |        Sponsor:
-------------------------------------------------+-------------------------
Changes (by juga):

 * status:  needs_review => closed
 * resolution:   => fixed


Comment:

 gk and i had a converstation about this ticket.

 I think the goal of this ticket was that relay operators can see whether
 their relay is reported or not in the bandwidth file and i think it'd be
 even better if sbws would report about the aproximately the same number of
 relays as torflow, in which case it's not so important to show which are
 the relays not reported, since they'll be very few.

 gk pointed out interesting questions in this ticket:

 1. how do we compare with torflow?

 I think that with the lines included in the report, we can compare the
 number of relays in the consensus not reported by torflow and the ones not
 reported by sbws.

 For example, on 2020-04-18 06:00:
 The consensus has 6767 relays.
 longclaw is reporting on 8121 relays, from which 6609 are relays to vote.
 longclaw is not reporting about 10 relays in the consensus and it's not
 voting on 593 relays in it. It's not shown there, but in my experience
 many of the relays reported are not the ones in the consensus.
 760 of the relays reported had descriptors updated and 887 had router
 statuses updated.

 Compared with a Torflow instance:
 Torflow is reporting (and voting) about 8310 and 57 relays in the
 consensus are not in Torflow.
 We can't know whether the reported relays have their descriptors and
 router statuses updated.

 After longclaw is using sbws from maint-1.1 branch, on 2020-04-21 12:00:
 The consensus has 6790 relays.
 longclaw is reporting on 8084 relays, from which 6548 are relays to vote.
 longclaw is not reporting about 62 relays in the consensus and it's not
 voting on 626 of them.
 4651 of the relays reported had descriptors updated and 1130 had router
 statuses updated.

 Compared with a Torflow instance, torflow is reporting (and voting) on
 8481 relays, from which 129 are not in the consensus.

 2. how to check which are the relays "excluded by all sbws" instances?

 This will vary in each consensus since i think the main reason why sbws is
 not voting on some relays is due their relay descriptors/statuses not
 being updated.
 We could still report the common relays not being voted by sbws instances
 in each consensus.
 However i think that as, mentioned above, it'd be more useful to have sbws
 voting on aproximaely the same relays as torflow.

 gk and i thought that probably we don't have to do more in this ticket,
 but rather have another ticket were we check whether the bugfixes we have
 been working on are making sbws behave as torflow.
 I've created #33947 for this and i'm going to close this ticket for now,
 we can reopen it if we think we should focus on showing which are the
 relays excluded.

--
Ticket URL: <https://trac.torproject.org/projects/tor/ticket/30735#comment:12>
Tor Bug Tracker & Wiki <https://trac.torproject.org/>
The Tor Project: anonymity online