[tor-bugs] #31051 [Internal Services/Tor Sysadmin Team]: bungei running out of space

[Tor Bug Tracker & Wiki]

#31051: bungei running out of space
-----------------------------------------------------+-----------------
     Reporter:  anarcat                              |      Owner:  tpa
         Type:  defect                               |     Status:  new
     Priority:  Medium                               |  Milestone:
    Component:  Internal Services/Tor Sysadmin Team  |    Version:
     Severity:  Normal                               |   Keywords:
Actual Points:                                       |  Parent ID:
       Points:                                       |   Reviewer:
      Sponsor:                                       |
-----------------------------------------------------+-----------------
 we got this warning from nagios this weekend:

 {{{
 DISK WARNING - free space: /srv/backups/bacula 1886723 MB (9% inode=99%)
 }}}

 indeed, the main storage is full:

 {{{
 Sys. de fichiers                    Taille Utilisé Dispo Uti% Monté sur
 /dev/mapper/vg_bulk-backups--bacula    20T     18T  1,6T  93%
 /srv/backups/bacula
 }}}

 There's plenty of free space on the VG, however:

 {{{
   VG      #PV #LV #SN Attr   VSize  VFree
   vg_bulk   1   2   0 wz--n- 72,60t 51,60t
 }}}

 So this could quickly be resolved by just resizing that partition. But
 it's interesting to note that the vast majority of storage in use comes
 from the static content. I suspect there's a lot of duplication around
 those and we could save space in backups by being a little smarter about
 this:

 {{{
 ncdu 1.13 ~ Use the arrow keys to navigate, press ? for help
 --- /srv/backups/bacula
 -----------------------------------------------------------------------------------------------------------------------------------------------------------------------
     4,3 TiB [ 25,0% ##########] /arlgirdense.torproject.org
     4,3 TiB [ 24,5% ######### ] /staticiforme.torproject.org
     2,1 TiB [ 11,9% ####      ] /archive-01.torproject.org
     1,1 TiB [  6,2% ##        ] /perdulce.torproject.org
   871,0 GiB [  4,9% #         ] /colchicifolium.torproject.org
   806,1 GiB [  4,5% #         ] /Catalog
   554,4 GiB [  3,1% #         ] /corsicum.torproject.org
   375,1 GiB [  2,1%           ] /gillii.torproject.org
   237,5 GiB [  1,3%           ] /eugeni.torproject.org
   209,0 GiB [  1,2%           ] /hetzner-nbg1-01.torproject.org
 }}}

 Above is the top-ten in disk usage. It's interesting to note that
 archive01 is only half of its partners. We should also note that
 arlgirdense is likely going to go away eventually, because archive-01 will
 replace it.

--
Ticket URL: <https://trac.torproject.org/projects/tor/ticket/31051>
Tor Bug Tracker & Wiki <https://trac.torproject.org/>
The Tor Project: anonymity online