[metrics-bugs] #21219 [Metrics/CollecTor]: collector should rm data from out/ after archiving

[Tor Bug Tracker & Wiki]

#21219: collector should rm data from out/ after archiving
-------------------------------+------------------------------
 Reporter:  tom                |          Owner:  metrics-team
     Type:  enhancement        |         Status:  new
 Priority:  Medium             |      Milestone:
Component:  Metrics/CollecTor  |        Version:
 Severity:  Normal             |     Resolution:
 Keywords:                     |  Actual Points:
Parent ID:                     |         Points:
 Reviewer:                     |        Sponsor:
-------------------------------+------------------------------

Comment (by karsten):

 You're right.  It's safe to delete descriptors that are at least N = 2
 months old.  In fact, on the main CollecTor instance I usually delete
 descriptors that are at least N = 1.5 months old.  But I do this manually,
 because of https://xkcd.com/1205/ and https://xkcd.com/1319/, and more
 importantly because I'm afraid of messing up with scripts and accidentally
 deleting all descriptors.

 I admit that these reasons don't fully apply anymore with three CollecTor
 instances running.  Would you submit a patch to delete descriptors older
 than N = 2 months, possibly even with a configurable N?

 https://gitweb.torproject.org/collector.git/tree/src/main/resources
 /create-tarballs.sh

 And if you have ideas for making that script even less copy-and-pasty,
 please feel free to tweak it!

--
Ticket URL: <https://trac.torproject.org/projects/tor/ticket/21219#comment:1>
Tor Bug Tracker & Wiki <https://trac.torproject.org/>
The Tor Project: anonymity online