[metrics-bugs] #32660 [Metrics/Onionoo]: onionoo-backend is killing the ganeti cluster

[Tor Bug Tracker & Wiki]

#32660: onionoo-backend is killing the ganeti cluster
-----------------------------+------------------------------
 Reporter:  anarcat          |          Owner:  metrics-team
     Type:  defect           |         Status:  needs_review
 Priority:  Medium           |      Milestone:
Component:  Metrics/Onionoo  |        Version:
 Severity:  Normal           |     Resolution:
 Keywords:                   |  Actual Points:
Parent ID:                   |         Points:
 Reviewer:                   |        Sponsor:
-----------------------------+------------------------------

Comment (by anarcat):

 before we start doing optimization tradeoffs, especially ones involving
 more CPU time, I think we should  diagnose the problem further. running
 checksums can take a while and might impose extra load on the server...
 couldn't we use timestamps or some faster mechanism?

 we should also diagnose why our numbers differ. there might be another
 process writing all that data in there...

 someone(tm) should run iotop during the peak periods to figure that out.
 :) i'll see if i can do that soon.

--
Ticket URL: <https://trac.torproject.org/projects/tor/ticket/32660#comment:10>
Tor Bug Tracker & Wiki <https://trac.torproject.org/>
The Tor Project: anonymity online