[tor-bugs] #17321 [CollecTor]: Index to better support downloaders

[Tor Bug Tracker & Wiki]

#17321: Index to better support downloaders
-----------------------------+-----------------
     Reporter:  atagar       |      Owner:
         Type:  enhancement  |     Status:  new
     Priority:  major        |  Milestone:
    Component:  CollecTor    |    Version:
   Resolution:               |   Keywords:
Actual Points:               |  Parent ID:
       Points:               |    Sponsor:
-----------------------------+-----------------
Changes (by karsten):

 * cc: iwakeh (added)


Comment:

 Some file names contain the timestamp, but not all of them.  Even worse,
 some files contain dates and may still change throughout the day.  So,
 yes, we'll need the timestamp.

 Please find the two attached files containing a sample index.json of the
 entire directory tree served by CollecTor.  We'll want to remove a few
 files like .html from that, but that's pretty much what we'd serve.
 There's also a pretty-index.json with the same content just printed
 prettily, for the discussion here.  These files don't contain the "types"
 field yet.

 What do you think, should we move forward with this?  I could start
 providing this file (index.json, not pretty-index.json, unless there's a
 reason for providing that) in the next few days.

 I'm also copying iwakeh who helps maintain metrics-lib and Onionoo and who
 generally has good input on these things.

--
Ticket URL: <https://trac.torproject.org/projects/tor/ticket/17321#comment:5>
Tor Bug Tracker & Wiki <https://trac.torproject.org/>
The Tor Project: anonymity online