[tor-bugs] #22428 [Metrics/CollecTor]: add webstats module to collector

[Tor Bug Tracker & Wiki]

#22428: add webstats module to collector
-------------------------------+-----------------------------------
 Reporter:  iwakeh             |          Owner:  iwakeh
     Type:  enhancement        |         Status:  needs_information
 Priority:  Medium             |      Milestone:
Component:  Metrics/CollecTor  |        Version:
 Severity:  Normal             |     Resolution:
 Keywords:                     |  Actual Points:
Parent ID:                     |         Points:
 Reviewer:                     |        Sponsor:
-------------------------------+-----------------------------------

Comment (by karsten):

 Regarding metadata in output files, I think the least bad solution is to
 prefix existing filenames with `the-measuring.host-`. Adding funny/invalid
 data lines just for metadata seems worse, and wrapping files into tarballs
 together with a metadata file might make it unnecessary complex to process
 files. Maybe we can't give up on parsing metadata from filenames just yet,
 though we can still try to reduce it to cases like this where adding
 metadata to files is not a good option.

 An upside of this approach is that we can easily copy over existing
 sanitized web logs without opening them, adding metadata, and closing
 them. The only thing we need to do is rename them, like
 `https://webstats.torproject.org/out/meronense.torproject.org/metrics.torproject
 .org-access.log-20170704.xz` to `meronense.torproject.org-
 metrics.torproject.org-access.log-20170704.xz`.

--
Ticket URL: <https://trac.torproject.org/projects/tor/ticket/22428#comment:15>
Tor Bug Tracker & Wiki <https://trac.torproject.org/>
The Tor Project: anonymity online