[tor-dev] Comparing Stem, metrics-lib, and zoossh

[Karsten Loesing]

-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1

Hello Philipp and iwakeh, hello list,

Damian and I sat down yesterday at the dev meeting to talk about doing
a comparison of the various descriptor-parsing libraries with respect
to capabilities, run-time performance, memory usage, etc.

We put together a list of things we'd like to compare and tests we'd
like to run that we thought we'd want to share with you.  Damian and I
will both be working on these for metrics-lib for a short while and
then switch to Stem.  Please feel free to join us in these effort.
The result is supposed to live on Stem's home page unless somebody
comes up with a better place.

Thanks!

All the best,
Damian and Karsten


On 30/09/15 10:57, Karsten Loesing wrote:
> 1. capabilities - supported descriptor types - all the ones on
> CollecTor's formats.html - hidden service descriptors (have an
> agreed @type for that) - getting/producing descriptors - reading
> from file/directory - reading from tarballs - reading from
> CollecTor's .xz-compressed tarballs - fetching from CollecTor -
> downloading from directories (authorities or mirrors) - generating
> (for unit test) - recognizing @type annotation - inferencing from
> file name - keeping reading history - user documentation -
> validation (format, crypto, successful sanitization) - packages
> available - how much usage by (large) applications
> 
> 2. performance (CPU time, memory overhead) - compression:
> .xz-compressed tarballs/decompressed tarballs/plain-text -
> descriptor type: consensus, server descriptor, extra-info 
> descriptor, microdescriptors - validation: on or off (allows lazy
> loading)
> 
> 3. tests by descriptor type - @type server-descriptor 1.0 - Stem's
> "List Outdated Relays" - average advertised bandwidth - fraction of
> relays that can exit to port 80 - @type extra-info 1.0 - sum of all
> written and read bytes from write-history/read-history - number of
> countries from which v3 requests were received - @type
> network-status-consensus-3 - average number of relays with Exit
> flag - @type network-status-vote-3 - Stem's "Votes by Bandwidth
> Authorities" - @type dir-key-certificate-3 - @type
> network-status-microdesc-consensus-3 1.0 - @type microdescriptor
> 1.0 - look at single microdesc cons and microdescs, compile list
> of extended families - fraction of relays that can exit to port 80 
> - @type network-status-2 1.0 - @type directory 1.0 - @type
> bridge-network-status - @type bridge-server-descriptor - @type
> bridge-server-descriptor 1.0 - @type bridge-extra-info 1.3 - @type
> bridge-pool-assignment - @type tordnsel 1.0 - @type torperf 1.0
> 
> 4. action items - get in touch with Dererk for packaging
> metrics-lib for Debian
> 

-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1
Comment: GPGTools - http://gpgtools.org

iQEcBAEBAgAGBQJWDOCYAAoJEJD5dJfVqbCrwAMIAJ0Chlui/Qv5kiGy9WZVkoKU
UsxiK1IGVh/eGrpunzKdWQtVhvv+285Ab0OUB4URTK5mpOE+bKD3vcFy3ziXvpke
xl5X2rZ/MtzJpRrGcAue0+2YZBrmOsGtGbclH9LcnTRgs65AKFMUp/SPf30LS0Pw
l8tg6xUtB7/97qxwNDj08J9Yp/YtWaankE0zuI3py10qa/2RTXBSjZ0JkemLmhxL
zVy2yUirNdC+bq9rNh+qh2LMIIEEVbGX2sHJx4JdbLjrJAyrSPtyFhXaih4jkIz3
TptTymRwX8Peny7zEJkkGojH6FkOW0gwpfaZBd4vkphLUbyupHIt3k9aKS15Je0=
=uGPS
-----END PGP SIGNATURE-----