[tor-bugs] #25317 [Metrics/CollecTor]: Enable webstats to process large (> 2G) logfiles

[Tor Bug Tracker & Wiki]

#25317: Enable webstats to process large (> 2G) logfiles
-------------------------------+------------------------------
 Reporter:  iwakeh             |          Owner:  iwakeh
     Type:  defect             |         Status:  needs_review
 Priority:  High               |      Milestone:
Component:  Metrics/CollecTor  |        Version:
 Severity:  Normal             |     Resolution:
 Keywords:                     |  Actual Points:
Parent ID:                     |         Points:
 Reviewer:                     |        Sponsor:
-------------------------------+------------------------------
Changes (by iwakeh):

 * status:  accepted => needs_review


Comment:

 Please review two commits
 [https://gitweb.torproject.org/user/iwakeh/collector.git/log/?h=task-25317
 this patch branch] based on the current master branch.  The first commit
 adapts collector to the changes introduced to metrics-lib when adding the
 log line sub-interfaces.  The next tackles the memory issues.  See commit
 comment for details.  There is also a speed-up of 50% compared to the
 previous version.

 This depends on the metrics-lib patch of #25329.

--
Ticket URL: <https://trac.torproject.org/projects/tor/ticket/25317#comment:3>
Tor Bug Tracker & Wiki <https://trac.torproject.org/>
The Tor Project: anonymity online