[metrics-team] Collector 1.1 Instance

Wed Nov 2 08:28:08 UTC 2016

-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA256

Hi Tom,

On 01/11/16 20:37, Tom Ritter wrote:
> I've had it running for a few days here: https://bwauth.ritter.vg/

Neat!  Are you planning to keep it running in the longer term?  If so,
I'd want to enable synchronization from your CollecTor instance for
including descriptors that the primary CollecTor instance is missing.

I'm already synchronizing from iwakeh's CollecTor instance since
yesterday, and I think that having a third instance run by a trusted
person would be great.

Would it be difficult for you to create a new subdomain like
https://collector.ritter.vg/?  I could imagine that we'll soon put
links to mirrors on the CollecTor page, and people might be confused
by the bwauth part.

> Historical data may be spotty but I didn't delete it.  My config is
> below.

Looks good, except for one setting: `BridgeSources = Local` won't do
anything, because you don't have Bifroest's bridge descriptor
tarballs.  You could either disable the module by setting
`BridgedescsActivated = false`, or you could synchronize sanitized
bridge descriptors from the primary CollecTor instance.

> One thing I noticed is that create-tarballs takes a LONG time. I
> mean I know it's supposed to, but I'm talking 14 hours. (I think
> the extra-info files seem to be the big ones).

True.  It's taking 27.5 hours on the primary CollecTor instance:

Tue Nov 1 03:25:01 UTC 2016 Starting
[...]
Wed Nov 2 07:00:27 UTC 2016 Finished.

That's why that script is only running every 3 days.

And yes, the problem is to tar up the many small files.  Ideally, we'd
like to create these tarballs in Java and also compress them there.
But we haven't had the time yet to look into that.

Thanks for setting up and running a CollecTor instance!

All the best,
Karsten

> RunOnce = False ShutdownGraceWaitMinutes = 10 BridgedescsActivated
> = true BridgedescsPeriodMinutes = 60 BridgedescsOffsetMinutes = 9 
> ExitlistsActivated = true ExitlistsPeriodMinutes = 60 
> ExitlistsOffsetMinutes = 2 RelaydescsActivated = true 
> RelaydescsPeriodMinutes = 30 RelaydescsOffsetMinutes = 5 
> TorperfActivated = true TorperfPeriodMinutes = 360 
> TorperfOffsetMinutes = 1 UpdateindexActivated = true 
> UpdateindexPeriodMinutes = 2 UpdateindexOffsetMinutes = 0 
> InstanceBaseUrl = https://bwauth.ritter.vg/collector/ IndexPath =
> index ArchivePath = archive RecentPath = recent OutputPath = out 
> StatsPath = stats SyncPath = sync RelaySources = Remote 
> RelaySyncOrigins = https://collector.torproject.org 
> RelayCacheOrigins = in/relay-descriptors/cacheddesc/ 
> RelayLocalOrigins = in/relay-descriptors/archives/ 
> KeepDirectoryArchiveImportHistory = false 
> DirectoryAuthoritiesAddresses = 
> 128.31.0.39:9131,86.59.21.38,194.109.206.212,131.188.40.189,193.23.244.244,171.25.193.9:443,154.35.175.225,199.254.238.52
>
> 
DirectoryAuthoritiesFingerprintsForVotes =
> 0232AF901C31A04EE9848595AF9BB7620D4C5B2E,14C131DFC5C6F93646BE72FA1401C02A8DF2E8B4,23D15D965BC35114467363C165C4F724B64B4F66,49015F787433103580E3B66A1707A00E60F2D15B,D586D18309DED4CD6D57C18FDB97EFA96D330566,E8A9C45EDE6D711294FADF8E7951F4DE6CA56B58,ED03BB616EB2F60BEC80151114BB25CEF515B226,EFCBE720AB3A82B99F9E953CD5BF50F7EEFC7B97
>
> 
DownloadAllServerDescriptors = true
> DownloadAllExtraInfoDescriptors = true 
> CompressRelayDescriptorDownloads = true BridgeSources = Local 
> BridgeSyncOrigins = https://collector.torproject.org 
> BridgeLocalOrigins = in/bridge-descriptors/ 
> ReplaceIpAddressesWithHashes = false BridgeDescriptorMappingsLimit
> = inf ExitlistSources = Remote ExitlistSyncOrigins =
> https://collector.torproject.org ExitlistUrl =
> https://check.torproject.org/exit-addresses TorperfHosts = torperf,
> http://torperf.torproject.org/
> 
> TorperfFilesLines = torperf 51200 50kb.data 50kb.extradata,
> torperf 1048576 1mb.data 1mb.extradata, torperf 5242880 5mb.data
> 5mb.extradata _______________________________________________ 
> metrics-team mailing list metrics-team at lists.torproject.org 
> https://lists.torproject.org/cgi-bin/mailman/listinfo/metrics-team
> 

-----BEGIN PGP SIGNATURE-----
Comment: GPGTools - http://gpgtools.org

iQEcBAEBCAAGBQJYGaOYAAoJEC3ESO/4X7XBwuQH/23icc2BPgxueXwTfSqnGrlR
4rfAfS1yVi8wVZAlaGPvuzxb1NC11JKyu2/tj5/3fEUzlcrtiIMXhq1EZqFI+QGq
mbtR2knbQ98OW+8MkZyXjm7EJMO8tp7PYxwwdSCKGTkxalbWQhgRQM0hpSeIOCcV
TIC4w8h07QqzL7RCjuKpCAMcuJ/EfuLBSK4naqzB5NH1p1j1GczHxiRicGQJtfU9
Il5TxjM8aK4kZ/zGwBm2OAdpgdRGyLnfBmfRFhYY2N4upU4KiG9c5gBlsoDaawsB
hrl2lPCebwc34xvIdSzVI55e03L/cCEM3GWG43EDFwr0f+O60YqYouw0mZbwruo=
=fU+/
-----END PGP SIGNATURE-----