[tor-bugs] #25575 [Internal Services/Tor Sysadmin Team]: Server space request (175 GB total) for hosting Tor Browser downloads

[Tor Bug Tracker & Wiki]

#25575: Server space request (175 GB total) for hosting Tor Browser downloads
-------------------------------------------------+-------------------------
 Reporter:  arthuredelstein                      |          Owner:  tpa
     Type:  project                              |         Status:
                                                 |  needs_information
 Priority:  Medium                               |      Milestone:
Component:  Internal Services/Tor Sysadmin Team  |        Version:
 Severity:  Normal                               |     Resolution:
 Keywords:                                       |  Actual Points:
Parent ID:  #20628                               |         Points:
 Reviewer:                                       |        Sponsor:
-------------------------------------------------+-------------------------

Comment (by weasel):

 The hardlinking thing is not quite as you describe.  In particular, we
 never hardlink files owned by the non-mirror user.  So we copy things from
 dist-master, and then we hardlink the various trees under control of the
 mirroring stuff.

 The mirroring stuff itself does not necessarily need twice the disk space
 for an update, but it needs the disk space of the union of the old and new
 tree.  This is true for the master *and* for each mirror.  In general,
 more smaller updates are better than one big one.

 Let's assume that between two updates not more than 100g changes, and that
 you need 250gb in total, of which 100g is already being used.

 Then the disk space on the static-master is tight, but if we run out there
 it's easy to expand and also we notice quickly.  Of the static mirrors
 that cover dist, archeotrichon, listera, and saxatile are fine (now that
 some of them have been resized).  savii isn't and will need to be retired
 and/or moved.

 The CDN backends are ok for now too, but they will need some redesigning
 soonish anyway.

 So, todo list:
   - move/retire savii as a dist.tpo mirror.
   - decide who the cdn redirectors should be and make sure they have
 sufficient disk space.
   - decide who the cdn backends should be and make sure they have
 sufficient disk space.

--
Ticket URL: <https://trac.torproject.org/projects/tor/ticket/25575#comment:7>
Tor Bug Tracker & Wiki <https://trac.torproject.org/>
The Tor Project: anonymity online