[tor-bugs] #6395 [Metrics Data Processor]: Can we remove GetTor statistics from metrics-*?

[Tor Bug Tracker & Wiki]

#6395: Can we remove GetTor statistics from metrics-*?
------------------------------------+---------------------------------------
 Reporter:  karsten                 |          Owner:     
     Type:  task                    |         Status:  new
 Priority:  normal                  |      Milestone:     
Component:  Metrics Data Processor  |        Version:     
 Keywords:                          |         Parent:     
   Points:                          |   Actualpoints:     
------------------------------------+---------------------------------------

Comment(by karsten):

 Replying to [comment:9 ioerror]:
 > Karsten, I'm confused - why not simply define a format that is expected
 and fail to graph (but someone can store) it; all the while graphs are
 regularly generated?
 >
 > The easy thing is to just ensure that the parser is implemented in
 GetTor and GetTor attempts to parse the data before sending it onward. In
 the event that it can't parse the data, we send kaner or me or someone an
 email about it. The graphs might get choppy from time to time but never in
 a time sensitive way, never with lost data, etc.

 What happened in June/early July was just one way for the GetTor-metrics
 connection to break.  There are plenty other problems that maintaining
 GetTor stats on the metrics side involves.  I mentioned some of them in my
 earlier post: bugs in the metrics-* code, more work to refactor metrics-*,
 additional code in parsing library, need for documentation of GetTor stats
 format, etc.

 > Most of that can happen on the GetTor side - I feel like the rest is
 implemented on your side already. It seems a bit much to maintain a
 totally different site for an area of the metrics page that already
 exists.

 The idea was to write a command-line tool that downloads GetTor's existing
 stats export (which covers months of data, or possibly the entire
 aggregate history of GetTor operation if we want to) and plots a graph
 locally.  No website involved.  If you or Andrew want a graph, you go to
 your `~/src/gettor/` and run `./plot-stats.py` or maybe even `./plot-
 stats.py --from 2012-06-01 --to 2012-06-30`.  I would write/document/test
 that code, and kaner would maintain it in the GetTor repo (thanks for
 that!).  Would that work for you?

-- 
Ticket URL: <https://trac.torproject.org/projects/tor/ticket/6395#comment:11>
Tor Bug Tracker & Wiki <https://trac.torproject.org/>
The Tor Project: anonymity online