[tor-bugs] #2506 [Tor Relay]: Design and implement a more compact GeoIP file format

[Tor Bug Tracker & Wiki]

#2506: Design and implement a more compact GeoIP file format
-------------------------+--------------------------------------------------
 Reporter:  rransom      |          Owner:                  
     Type:  enhancement  |         Status:  new             
 Priority:  normal       |      Milestone:  Tor: unspecified
Component:  Tor Relay    |        Version:                  
 Keywords:               |         Parent:                  
   Points:               |   Actualpoints:                  
-------------------------+--------------------------------------------------

Comment(by rransom):

 Replying to [comment:3 mikey]:
 > Just another data point, moot if the original intent is to always read
 from disk, never load the whole GeoIP database into RAM.
 >
 > But, if the intent is to save disk space once installed, LZMA produces
 decent results (tested with 7zip and April 2011 files):
 > 1.1M GeoIP.dat compresses into 436KiB dat.7z

 In order to use Maxmind's binary format, we would need to either use their
 (LGPLed) library or reverse-engineer the format.  If we implement our own
 binary format, I strongly suspect that we can fit the data we need into
 less than 436 kiB ''without'' additional compression.  It would also be
 better to avoid using LZMA, as that would require linking Tor to yet
 another library.

-- 
Ticket URL: <https://trac.torproject.org/projects/tor/ticket/2506#comment:4>
Tor Bug Tracker & Wiki <https://trac.torproject.org/>
The Tor Project: anonymity online