[tor-bugs] #25100 [Metrics/CollecTor]: Make CollecTor's webstats module use less RAM and CPU time

[Tor Bug Tracker & Wiki]

#25100: Make CollecTor's webstats module use less RAM and CPU time
-------------------------------+--------------------------------
 Reporter:  karsten            |          Owner:  iwakeh
     Type:  enhancement        |         Status:  needs_revision
 Priority:  High               |      Milestone:
Component:  Metrics/CollecTor  |        Version:
 Severity:  Normal             |     Resolution:
 Keywords:                     |  Actual Points:
Parent ID:                     |         Points:
 Reviewer:                     |        Sponsor:
-------------------------------+--------------------------------

Comment (by iwakeh):

 Be aware that the compression achieved using the in-memory db will not be
 based on normalization and/or a complex db schema, but rather on an
 efficient underlying, transparent storage mechanism for strings and
 repeated values.  It won't need the review time the deployment of a real
 persistent db would require.

 The "manual compression" also increases review and later maintenance time
 (I know that from reviewing older Metrics' code bases).

 There would be still some one-time overhead investigating which in-memory
 solution offers the wanted features and to get it running.

 I'll take a look at both the "manual compression" and in-memory db in
 parallel; either one is done very quickly or a show-stopper comes up for
 the other approach.

--
Ticket URL: <https://trac.torproject.org/projects/tor/ticket/25100#comment:11>
Tor Bug Tracker & Wiki <https://trac.torproject.org/>
The Tor Project: anonymity online