[metrics-team] server-descriptor not readable (2018-02-08-11-05-00-server-descriptors has >30k descriptors)

[nusenu]

Hi Kathi,

(I'm adding the operator (toralf.foerster) of the two relays causing the descriptor file sizes to increase)

> I ran into a problem when trying to read the server descriptors from
> the file
> https://collector.torproject.org/recent/relay-descriptors/server-descriptors/2018-02-08-11-05-00-server-descriptors.
> The reader simply gets stuck without any error/warning and never
> finishes. All other descriptor files currently in "recent" pass
> fine. I noticed that this file is particularity big: 71M instead of
> usually round 1-2M, but I can't tell if this is causing the problem. 
> Any help/workaround would be great!


I assume you use stem for parsing. 
What is your stem and python version?


This file just loads fine here (takes < 1minute), but I'm curious
why it contains 30311 descriptors (instead of <1000).

Amount of descriptors per fingerprint sorted by first column:

    599 D11D11877769B9E617537B4B46BFB92B443DE33D
    599 1AF72E8906E6C49481A791A6F8F84F8DFEBBB2BA

These two tor instances run on the same server with version  0.3.3.1-alpha 
and are uploading a descriptor every other minute: 

2018-02-08 01:04:22 D11D11877769B9E617537B4B46BFB92B443DE33D
2018-02-08 01:05:20 D11D11877769B9E617537B4B46BFB92B443DE33D
2018-02-08 01:06:19 D11D11877769B9E617537B4B46BFB92B443DE33D
2018-02-08 01:07:21 D11D11877769B9E617537B4B46BFB92B443DE33D
2018-02-08 01:08:18 D11D11877769B9E617537B4B46BFB92B443DE33D
2018-02-08 01:09:18 D11D11877769B9E617537B4B46BFB92B443DE33D
2018-02-08 01:10:22 D11D11877769B9E617537B4B46BFB92B443DE33D
2018-02-08 01:11:21 D11D11877769B9E617537B4B46BFB92B443DE33D

Maybe we are looking at a bug here. 

@toralf foerster did you observer anything unusual in your logs?
Are your tor daemons constantly dying and restarting?

The the behaviour started on 2018-02-08 01:04:22 UTC for D11D..
and on 2018-02-05 01:31:19 for 1AF7..

    125 DE2C7F86669720B0FB9247C9C43BC4D58DE837C9
     86 85D492D33AFE3DD63EA68E5008A7D90D87BC586C
     61 64342130F715C4CD0DFF7C207D996600F41CE7C1
     29 CF9CD1E14CC37CE6979DF8E1DBBD279FE0EB53A5
     25 BF7B42D1A078AFA78DAEE46508191098963EC53E
     24 89C173C725A1F007626FD4AACF335E5C97CD94C1
     22 D44B2DD9E035E08EC295912E36421476B2FA61B2
     14 18BA49F1AFA3680D364B59BAC49F1CB9316E25CB



thanks for bringing this to our attention,
nusenu


-- 
https://mastodon.social/@nusenu
twitter: @nusenu_

-------------- next part --------------
A non-text attachment was scrubbed...
Name: signature.asc
Type: application/pgp-signature
Size: 833 bytes
Desc: OpenPGP digital signature
URL: <http://lists.torproject.org/pipermail/metrics-team/attachments/20180208/649ab335/attachment.sig>