[metrics-team] Unusually slow OnionPerf measurements

[Karsten Loesing]

On 2017-07-22 10:05, Karsten Loesing wrote:
> On 2017-07-20 16:57, Rob Jansen wrote:
>>
>>> On Jun 6, 2017, at 10:35 AM, Karsten Loesing <karsten at torproject.org> wrote:
>>>
>>> On 06.06.17 14:28, nusenu wrote:
>>>> Karsten Loesing:
>>>>> What changed on May 22?
>>>>
>>>> it correlates with the increase of users:
>>>> https://twitter.com/nusenu_/status/870335474518425600
>>>
>>> Aha.  Well, right, the increase could indeed be real.  Thanks!
>>>
>>> All the best,
>>> Karsten
>>
>>
>> I think the more likely reason is that when we changed to OnionPerf, we added new OnionPerf client vantage points in new geographic locations. The new vantage points would experience unique performance that would affect the median and quartiles reported in the metrics graphs. To check this, we could look at the performance reported by a single vantage point that was running both the old Torperf and the new OnionPerf to see if the performance for that single vantage point changed after switching from TorPerf to OnionPerf.
> 
> Hmm, but the increase is also visible on a single OnionPerf host:
> 
> https://metrics.torproject.org/torperf.html?start=2017-04-23&end=2017-07-22&source=op-nl&server=public&filesize=50kb

Oh, wow, I have an even better explanation: starting on May 22 we
included requests to both public servers and onion servers in the public
server numbers!

That's why the numbers went up for public servers and the numbers for
onion servers stopped showing up in the graph (as pointed out by Rob).

I'm attaching a graph image from before fixing this.

Then I fixed this in the database, so that the graphs on Tor Metrics are
correct. Here's the same graph as attached but with correct data:

https://metrics.torproject.org/torperf.html

Wow, that bug was better hidden than expected. Sorry for the confusion!

All the best,
Karsten



> 
> (No, I don't yet know where the gap in June comes from. But it seems
> unrelated to the May 22 increase.)
> 
> All the best,
> Karsten
> 
> 
>> (This has been on my mind for a while, finally remembered to respond.)
>>
>> Best,
>> Rob
>>
>>
>>
>> _______________________________________________
>> metrics-team mailing list
>> metrics-team at lists.torproject.org
>> https://lists.torproject.org/cgi-bin/mailman/listinfo/metrics-team
>>
> 
> 

-------------- next part --------------
A non-text attachment was scrubbed...
Name: torperf-public-2017-05-02-2017-07-31-all-50kb.png
Type: image/png
Size: 20530 bytes
Desc: not available
URL: <http://lists.torproject.org/pipermail/metrics-team/attachments/20170731/83663fd8/attachment-0001.png>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: signature.asc
Type: application/pgp-signature
Size: 495 bytes
Desc: OpenPGP digital signature
URL: <http://lists.torproject.org/pipermail/metrics-team/attachments/20170731/83663fd8/attachment-0001.sig>