[tor-bugs] #27356 [Metrics/ExoneraTor]: Reduce database size and variance of query response times

[Tor Bug Tracker & Wiki]

#27356: Reduce database size and variance of query response times
------------------------------------+--------------------------
     Reporter:  karsten             |      Owner:  metrics-team
         Type:  enhancement         |     Status:  new
     Priority:  Medium              |  Milestone:
    Component:  Metrics/ExoneraTor  |    Version:
     Severity:  Normal              |   Keywords:
Actual Points:                      |  Parent ID:
       Points:                      |   Reviewer:
      Sponsor:                      |
------------------------------------+--------------------------
 The ExoneraTor database has grown to 262 GB, and sometimes queries can run
 for up to a minute or even longer (#17488). Both issues are known for
 years, and they're getting even worse over time as new data gets added.

 Sebastian and I discussed possible mitigations over two years ago, and we
 came up with an improved database schema. Well, Sebastian did the bulk of
 the work there.

 I picked up this work, rebased it to current master, made some fixes, and
 ran tests on a local database copy. Let's try to merge and deploy this in
 the next couple of weeks before the code gets old again like last time.

--
Ticket URL: <https://trac.torproject.org/projects/tor/ticket/27356>
Tor Bug Tracker & Wiki <https://trac.torproject.org/>
The Tor Project: anonymity online