[tor-bugs] #22983 [Metrics/metrics-lib]: add a descriptor interface and implementation for web-logs

[Tor Bug Tracker & Wiki]

#22983: add a descriptor interface and implementation for web-logs
---------------------------------+------------------------------
 Reporter:  iwakeh               |          Owner:  metrics-team
     Type:  enhancement          |         Status:  new
 Priority:  Medium               |      Milestone:
Component:  Metrics/metrics-lib  |        Version:
 Severity:  Normal               |     Resolution:
 Keywords:                       |  Actual Points:
Parent ID:                       |         Points:
 Reviewer:                       |        Sponsor:
---------------------------------+------------------------------

Comment (by karsten):

 Random thought: these logs can be really huge and also quite repetitive.
 Maybe we can try to save a bit of memory by trying out a few things when
 parsing them. Ideas:
  1. Store indexes into the raw descriptor string rather than copies of
 strings.
  2. Alternatively, only store fields that have changed compared to the
 previous line. If a field has not changed, store a reference to the first
 line that contains the same field contents. This makes use of the fact
 that lines are sorted.
  3. Maybe don't even store the raw descriptor string and instead throw an
 exception when it gets called. Only do this if 2 requires a lot less
 memory than 1 above.

--
Ticket URL: <https://trac.torproject.org/projects/tor/ticket/22983#comment:1>
Tor Bug Tracker & Wiki <https://trac.torproject.org/>
The Tor Project: anonymity online