[tor-bugs] #7828 [Stem]: Run descriptor parser over all prior descriptors

[Tor Bug Tracker & Wiki]

#7828: Run descriptor parser over all prior descriptors
-------------------------+--------------------------------------------------
 Reporter:  atagar       |          Owner:  karsten 
     Type:  task         |         Status:  accepted
 Priority:  normal       |      Milestone:          
Component:  Stem         |        Version:          
 Keywords:  descriptors  |         Parent:          
   Points:               |   Actualpoints:          
-------------------------+--------------------------------------------------

Comment(by atagar):

 > Okay, I started running this on serra. This will take a few days to run.
 Good thing serra is bored anyway.

 Thanks!

 > I'm feeding it with decompressed tarballs. That's what's fastest with
 metrics-lib.

 In looking back at our "Python metrics-lib' thread from 3/25/12 it looks
 like stem was slower with uncompressed tarballs, but not disastrously so.
 It's something that would be really nice to fix, but probably isn't
 critical for this.

 {{{
 Ahh, you're right. I tried again with a uncompressed tarball and the
 runtime for the same cached descriptor was 7.94 seconds (0.0059
 seconds per entry). That's about 1.5x slower than a plaintext
 descriptor which bad, but not outside the realm of being reasonable.
 }}}

 Cheers! -Damian

-- 
Ticket URL: <https://trac.torproject.org/projects/tor/ticket/7828#comment:5>
Tor Bug Tracker & Wiki <https://trac.torproject.org/>
The Tor Project: anonymity online