[tor-dev] Comparing Stem, metrics-lib, and zoossh

Karsten Loesing karsten at torproject.org
Thu Jan 14 10:25:08 UTC 2016


-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1

On 13/01/16 21:01, Philipp Winter wrote:
> On Wed, Jan 13, 2016 at 05:47:03PM +0100, Karsten Loesing wrote:
>> Do the Zoossh results there look plausible?
> 
> I'm surprised that descriptor parsing is so slow, but I think the 
> results are plausible, yes.  I should look into it.

Not to worry.  Turns out I compared the wrong numbers and Zoossh is
still the fastest parser in town (see my earlier reply in this thread).

What you could try, though, is extend Zoossh to parse tarballs rather
than directories.  This is more than 2 times faster in metrics-lib,
and it doesn't clutter your hard disk with thousands or millions of
tiny files.

All the best,
Karsten

-----BEGIN PGP SIGNATURE-----
Comment: GPGTools - http://gpgtools.org

iQEcBAEBAgAGBQJWl3eEAAoJEJD5dJfVqbCrKUoIALjQi8Ndy5Tu5NcvOmPoyw0H
tfEZST3jgvDddiQFpG8qPsZ47DmdPgA42d7oW7pJFhJMIn8ZhpvxRJb3r2M0eHGr
zarItm7MtPnidtfA1Bf1HYkOyyLArMgd9Ld+yE0GGDRBT/wjljmGo4k2kuoR8K0d
IeE9W2YsNrI1w6ilxedy6xQnnMfh0UrOxLg6wnYUvpkxrMyRbPVbPX9BAzna/mgx
svAYNsu3kDdc0lFTY/88P8xoVy35vyRaqNiuy7wswNGscGTR3bflq6JDXKdMI0HR
bgK0lrmeQrr2Z5qIu5HnyddG3u08hkpZufiv76oKpm+KsbuBBSD0HMLSu0uw5dU=
=z/EC
-----END PGP SIGNATURE-----


More information about the tor-dev mailing list