[metrics-team] Collector 1.1 Instance

[Tom Ritter]

I think this is likely the culprit?

2016-11-15 06:09:30,669 ERROR o.t.c.c.CollecTorMain:71 The relaydescs
module failed: Java heap space
2016-11-15 06:39:32,627 ERROR o.t.c.c.CollecTorMain:71 The relaydescs
module failed: Java heap space
2016-11-15 07:09:35,054 ERROR o.t.c.c.CollecTorMain:71 The relaydescs
module failed: Java heap space
2016-11-15 07:39:30,533 ERROR o.t.c.c.CollecTorMain:71 The relaydescs
module failed: Java heap space
2016-11-15 08:09:34,587 ERROR o.t.c.c.CollecTorMain:71 The relaydescs
module failed: Java heap space
2016-11-15 08:39:36,127 ERROR o.t.c.c.CollecTorMain:71 The relaydescs
module failed: Java heap space
2016-11-15 09:09:36,286 ERROR o.t.c.c.CollecTorMain:71 The relaydescs
module failed: Java heap space
2016-11-15 09:39:35,831 ERROR o.t.c.c.CollecTorMain:71 The relaydescs
module failed: Java heap space
2016-11-15 10:09:02,583 ERROR o.t.c.c.CollecTorMain:71 The relaydescs
module failed: Java heap space
2016-11-15 10:39:25,993 ERROR o.t.c.c.CollecTorMain:71 The relaydescs
module failed: Java heap space
2016-11-15 11:09:17,838 ERROR o.t.c.c.CollecTorMain:71 The relaydescs
module failed: Java heap space
2016-11-15 11:39:13,001 ERROR o.t.c.c.CollecTorMain:71 The relaydescs
module failed: Java heap space
2016-11-15 12:09:11,855 ERROR o.t.c.c.CollecTorMain:71 The relaydescs
module failed: Java heap space
2016-11-15 12:39:26,416 ERROR o.t.c.c.CollecTorMain:71 The relaydescs
module failed: Java heap space
2016-11-15 13:09:16,054 ERROR o.t.c.c.CollecTorMain:71 The relaydescs
module failed: Java heap space
2016-11-15 13:39:44,005 ERROR o.t.c.c.CollecTorMain:71 The relaydescs
module failed: Java heap space
2016-11-15 14:09:09,323 ERROR o.t.c.c.CollecTorMain:71 The relaydescs
module failed: Java heap space
2016-11-15 14:39:10,695 ERROR o.t.c.c.CollecTorMain:71 The relaydescs
module failed: Java heap space
2016-11-15 15:09:14,955 ERROR o.t.c.c.CollecTorMain:71 The relaydescs
module failed: Java heap space
2016-11-15 15:39:11,369 ERROR o.t.c.c.CollecTorMain:71 The relaydescs
module failed: Java heap space
2016-11-15 16:09:11,903 ERROR o.t.c.c.CollecTorMain:71 The relaydescs
module failed: Java heap space
2016-11-15 16:39:11,011 ERROR o.t.c.c.CollecTorMain:71 The relaydescs
module failed: Java heap space


java -XX:+PrintFlagsFinal -version | grep HeapSize tells me
    uintx MaxHeapSize                              := 2099249152      {product}

Which is just under 2GB. This VM has 8 GB of RAM.

I have tried with 6GB and that is still not enough: java -Xmx6g -jar
collector/collector-1.1.0.jar
This seems to be going so we'll see if it gets magically fixed....

-tom

On 15 November 2016 at 07:40, Karsten Loesing <karsten at torproject.org> wrote:
> -----BEGIN PGP SIGNED MESSAGE-----
> Hash: SHA256
>
> Hi Tom,
>
> On 03/11/16 10:05, Karsten Loesing wrote:
>> Can you update the following property in your collector.properties
>> (exactly like this, without trailing slash)?
>>
>> InstanceBaseUrl = https://collector.ritter.vg
>>
>> That URL should then be included at the top of:
>> https://collector.ritter.vg/index/index.json
>>
>> If that doesn't work, just restart the java process and look again
>> after the next updateindex module run.
>
> Hmm, it looks like you made this update.
>
> But your index.json looks somewhat strange.  For example, the latest
> relay descriptors are from 2 or 3 days ago:
>
> "path": "2016-11-13-07-00-00-consensus",
>
> "path": "2016-11-12-01-34-02-extra-infos",
>
> "path": "2016-11-13-01-00-00-consensus-microdesc",
>
> "path": "2016-11-12-01-34-02-micro",
>
> "path": "2016-11-12-01-34-02-server-descriptors",
>
> "path":
> "2016-11-12-02-00-00-vote-49015F787433103580E3B66A1707A00E60F2D15B-F3D1FB586A4628B64F3A3947B906ADB43DA2B1BF",
>
> Found out using:
>
> curl "https://collector.ritter.vg/index/index.json" | jq "." | grep
> path | less
>
> Is there anything in the logs?  (Feel free to move this thread off the
> list if you think it might require a lot of back and forth to debug this.)
>
>
> Huh, and just before sending this message, your index.json is empty in
> the sense of containing zero bytes.  Something's wrong there, I just
> wonder what that could be.
>
> All the best,
> Karsten
> -----BEGIN PGP SIGNATURE-----
> Comment: GPGTools - http://gpgtools.org
>
> iQEcBAEBCAAGBQJYKxBUAAoJEC3ESO/4X7XBnuEH/1mvmwULclu0Ydpk74ux16/U
> kJ41d62CS1yxhoVPZKZxC4L7Eyt3sozNVIuDsq+wQ+2mP7CyK3bVRYUTLv91c0yL
> w6nhVNbVadXvyZA+ED2PSfnH9Co6h5yfMNzT9qQmsghvvKiFbfdZ0QlRbVSqlhxW
> 1As0h+tGkysqXMLiQfL8Cq6ThATV0z0WI4z5ORiVOx0oX7DuFlX2KoH7BJF3T3PI
> cfIZYO8QTM3kQWCs/78htPQCpcZznRtZBWQSUv8PlNNmpzTX9wYRQWm/e/7fbAA7
> oZIX5CKPrZUoKmv1R/U4uoQOv3dVCgjul25MhdEpOjTR/MLjnA5wgmK7iDc6ldI=
> =XDN4
> -----END PGP SIGNATURE-----