[tor-bugs] #8049 [Stem]: Stem's DescriptorReader misses 10% of descriptors in tarballs

[Tor Bug Tracker & Wiki]

#8049: Stem's DescriptorReader misses 10% of descriptors in tarballs
---------------------+------------------------------------------------------
 Reporter:  karsten  |          Owner:  atagar  
     Type:  defect   |         Status:  assigned
 Priority:  normal   |      Milestone:          
Component:  Stem     |        Version:          
 Keywords:           |         Parent:          
   Points:           |   Actualpoints:          
---------------------+------------------------------------------------------

Comment(by atagar):

 Uggg, this ticket fills me with rage. I've tried a couple different
 approaches to repro this problem in our integ tests but no luck. Things
 that I've figured out are...

 * The troublesome descriptor parses just fine when alone or with a handful
 of other descriptors in a tarball.

 * If validation is turned off then things parse correctly...

 {{{
 atagar at morrigan:~/Desktop/stem$ python example.py
 READING TAR
 279043 descriptors in tarball.
 READING DIRECTORY
 279043 descriptors in extracted directory.
 }}}

 * The problem is that this descriptor somehow causes thousands of
 descriptors to go unread in the tarball as you observed, yet I haven't a
 clue why that is...

 {{{
 atagar at morrigan:~/Desktop/stem$ python example.py
 READING TAR
 250048 descriptors in tarball.
 READING DIRECTORY
 279042 descriptors in extracted directory.
 }}}

-- 
Ticket URL: <https://trac.torproject.org/projects/tor/ticket/8049#comment:11>
Tor Bug Tracker & Wiki <https://trac.torproject.org/>
The Tor Project: anonymity online