[tor-bugs] #2763 [Metrics]: Do we collect descriptors that don't get into the consensus?

[Tor Bug Tracker & Wiki]

#2763: Do we collect descriptors that don't get into the consensus?
---------------------+------------------------------------------------------
 Reporter:  arma     |          Owner:  karsten
     Type:  task     |         Status:  new    
 Priority:  normal   |      Milestone:         
Component:  Metrics  |        Version:         
 Keywords:           |         Parent:         
   Points:           |   Actualpoints:         
---------------------+------------------------------------------------------

Comment(by karsten):

 Right now we collect descriptors from three different sources:

  1. Every hour, we rsync part of gabelmoo's data directory to learn about
 the new consensus, new votes, and new descriptors.

  2. Every hour, after doing 1, we look at the descriptors to find
 referenced votes and descriptors that we don't have.  We download missing
 consensuses, votes, and descriptors from three directory authorities via
 HTTP.

  3. Once a day, we rsync the full content of weasel's directory archive
 script that downloads consensuses and votes and all descriptors referenced
 from there.

 So, if only moria1 knows about a descriptor that is not included in a vote
 or a descriptor, we won't collect it.  What would be the best way to
 download all descriptors from all directory authorities?  If we find a
 good solution, I'd like to stop doing 1 in the list above.

-- 
Ticket URL: <https://trac.torproject.org/projects/tor/ticket/2763#comment:2>
Tor Bug Tracker & Wiki <https://trac.torproject.org/>
The Tor Project: anonymity online