[tor-bugs] #22983 [Metrics/Library]: add a descriptor interface and implementation for web-logs

[Tor Bug Tracker & Wiki]

#22983: add a descriptor interface and implementation for web-logs
-----------------------------+-----------------------------------
 Reporter:  iwakeh           |          Owner:  metrics-team
     Type:  enhancement      |         Status:  needs_information
 Priority:  Medium           |      Milestone:  metrics-lib 2.2.0
Component:  Metrics/Library  |        Version:
 Severity:  Normal           |     Resolution:
 Keywords:                   |  Actual Points:
Parent ID:                   |         Points:
 Reviewer:                   |        Sponsor:
-----------------------------+-----------------------------------

Comment (by iwakeh):

 I'm not in favor of one or the other solution, I just want to clarify
 differences to processing other descriptors and make sure that all the
 differences are intended.

 Usually CollecTor's implementation determines, what is on disk; and, so
 far, there are only uncompressed descriptors on disk (even though the
 descriptors were received in compressed format from an authority).
 In that sense, CollecTor will receive compressed log files, but there is
 still the decision to also store these in compressed format on disk.
 The list of options:
 1. store logs decompressed on-disk and in-memory, descriptor supplies
 uncompressed bytes.  (no getCompressionType() needed.)
 2. store logs compressed on-disk and decompressed in-memory, descriptor
 supplies uncompressed bytes. (no getCompressionType() needed.)
 3. store logs compressed on-disk and in-memory, descriptor supplies
 uncompressed bytes (no getCompressionType(), but internal tracking
 needed).
 4. store logs compressed on-disk and in-memory, descriptor supplies un-
 and/or compressed bytes. requires getCompressionType() for the API user to
 make sense of compressed bytes.
 5. ...

 I think 2 is the minimal effort option currently.

--
Ticket URL: <https://trac.torproject.org/projects/tor/ticket/22983#comment:36>
Tor Bug Tracker & Wiki <https://trac.torproject.org/>
The Tor Project: anonymity online