[tor-dev] Comparing Stem, metrics-lib, and zoossh

[Damian Johnson]

Thanks! Yup, those results look reasonable. I was expecting a smaller
delta with server/extrainfo descriptors and larger one with
microdescriptors due to the lazy loading but oh well. What stem commit
and python version was this with?

Any thoughts on when you'll have time to clean up the metrics-lib
examples? Happy to add the results to our site when they're ready.

Cheers! -Damian

On Tue, Jan 12, 2016 at 12:40 AM, Karsten Loesing
<karsten at torproject.org> wrote:
> -----BEGIN PGP SIGNED MESSAGE-----
> Hash: SHA1
>
> On 12/01/16 05:38, Damian Johnson wrote:
>> Hi Karsten, implemented Stem counterparts of these (see attached).
>> On one hand the code is delightfully simple, but on the other
>> measurements I got were quite a bit slower. Curious to see what
>> you get when running at the same place you took your measurements.
>
> Cool!  Here's a comparison between metrics-lib and Stem run on the
> same system:
>
> server-descriptors-2015-11.tar:
>  - metrics-lib: 0.285430 ms
>  - Stem: 1.02 ms (357%)
>
> extra-infos-2015-11.tar:
>  - metrics-lib: 0.215500 ms
>  - Stem: 0.68 ms (316%)
>
> consensuses-2015-11.tar:
>  - metrics-lib: 246.713092 ms
>  - Stem: 1393.10 ms (565%)
>
> microdescs-2015-11.tar:
>  - metrics-lib: 0.066566 ms
>  - Stem: 0.66 ms (991%)
>
> Do these Stem results look plausible?
>
> Philipp, would you be able to write the Zoossh counterpart for the
> descriptor types supported by it?  I'm even more curious now how those
> numbers compare to metrics-lib and Stem.
>
> All the best,
> Karsten
> -----BEGIN PGP SIGNATURE-----
> Comment: GPGTools - http://gpgtools.org
>
> iQEcBAEBAgAGBQJWlLwCAAoJEJD5dJfVqbCr9y0H/i43rgx14dJXxxzUOnFLgUpm
> THfWdWoWZQo1P5mQx5WZctUAjk1OBTGUX+EyVZzwOoLjaZHKXX8Nu14et1kz0CSM
> K1qs0bDALgwXpVg5Rm79kIUanm0hcptWAlKkyqAu1X2Qfu/2fVKfCEvrDZJlVoCC
> ePuMLLxvRim0fBT4K1aRKRdxwob4HKv90N+4Ib+Llw0CLy8DQFJjKKDpmruxxcuq
> 62KzWz2Ck2AiJUPr2BYMxFMozyE40lQ38RcP6rbomF2PxqxP2W5pjs9R0jfzcRA5
> o28okykuFqaIp82rnuvmUXbYrYvPV/2GAqrsKAj+rHon/xeGDWsYZG/FOzIhZsU=
> =soLz
> -----END PGP SIGNATURE-----