[metrics-bugs] #22369 [Metrics/Censorship analysis]: Increase of users in Ukraine due to block of Russia-based services

[Tor Bug Tracker & Wiki]

#22369: Increase of users in Ukraine due to block of Russia-based services
-----------------------------------------+------------------------------
 Reporter:  dcf                          |          Owner:  metrics-team
     Type:  project                      |         Status:  new
 Priority:  Medium                       |      Milestone:
Component:  Metrics/Censorship analysis  |        Version:
 Severity:  Normal                       |     Resolution:
 Keywords:  censorship block ua          |  Actual Points:
Parent ID:                               |         Points:
 Reviewer:                               |        Sponsor:
-----------------------------------------+------------------------------

Comment (by dcf):

 The blckd.json file changed on 25 May, changing http URLs to https ones.
 Different versions of blckd.json are (so far) identifiable by their `Last-
 Modified` header.
 ||`Last-Modified: Tue, 23 May 2017 23:36:12 GMT` ||attachment:blckd.json
 ||
 ||`Last-Modified: Thu, 25 May 2017 16:58:04 GMT`
 ||attachment:blckd-20170525165818.json ||

 Here is a `decode` script that reads from stdin or a file:
 {{{
 #!/usr/bin/env python
 import sys
 def decode(data):
     return "".join(chr((ord(c) ^ 1234567890) & 0xff) for c in
 data.decode("utf-8"))
 f = len(sys.argv) == 2 and open(sys.argv[1]) or sys.stdin
 sys.stdout.write(decode(f.read()))
 }}}

 The difference between the `Tue, 23 May 2017 23:36:12 GMT` and `Thu, 25
 May 2017 16:58:04 GMT` versions is that the http URLs changed to https.
 {{{
 $ diff -u4 <(./decode blckd.json | jq .) <(./decode
 blckd-20170525165818.json | jq .)
 --- /dev/fd/63  2017-05-29 19:33:00.962827420 -0700
 +++ /dev/fd/62  2017-05-29 19:33:00.962827420 -0700
 @@ -1,59 +1,59 @@
  {
    "records": [
      {
        "host": "vk.com",
 -      "endpoint": "http://vk.com/ping.txt",
 +      "endpoint": "https://vk.com/ping.txt",
        "hash": "b5b607d573e6a901ef215db6b1247404c92bb9ce"
      },
      {
        "host": "vkontakte.ru",
 -      "endpoint": "http://vk.com/ping.txt",
 +      "endpoint": "https://vk.com/ping.txt",
        "hash": "b5b607d573e6a901ef215db6b1247404c92bb9ce"
      },
      {
        "host": "vk.me",
 -      "endpoint": "http://vk.com/ping.txt",
 +      "endpoint": "https://vk.com/ping.txt",
        "hash": "b5b607d573e6a901ef215db6b1247404c92bb9ce"
      },
      {
        "host": "vk.cc",
 -      "endpoint": "http://vk.com/ping.txt",
 +      "endpoint": "https://vk.com/ping.txt",
        "hash": "b5b607d573e6a901ef215db6b1247404c92bb9ce"
      },
      {
        "host": "ok.ru",
 -      "endpoint": "http://ok.ru/google55e918a7d2970a76.html",
 +      "endpoint": "https://ok.ru/google55e918a7d2970a76.html",
        "hash": "526aabc2501699fdcfe5c58f98db82eed849c904"
      },
      {
        "host": "odnoklassniki.ru",
 -      "endpoint": "http://ok.ru/google55e918a7d2970a76.html",
 +      "endpoint": "https://ok.ru/google55e918a7d2970a76.html",
        "hash": "526aabc2501699fdcfe5c58f98db82eed849c904"
      },
      {
        "host": "odnoklassniki.ua",
 -      "endpoint": "http://ok.ru/google55e918a7d2970a76.html",
 +      "endpoint": "https://ok.ru/google55e918a7d2970a76.html",
        "hash": "526aabc2501699fdcfe5c58f98db82eed849c904"
      },
      {
        "host": "ok.me",
 -      "endpoint": "http://ok.ru/google55e918a7d2970a76.html",
 +      "endpoint": "https://ok.ru/google55e918a7d2970a76.html",
        "hash": "526aabc2501699fdcfe5c58f98db82eed849c904"
      },
      {
        "host": "vk-cdn.net",
 -      "endpoint": "http://vk.com/ping.txt",
 +      "endpoint": "https://vk.com/ping.txt",
        "hash": "b5b607d573e6a901ef215db6b1247404c92bb9ce"
      },
      {
        "host": "userapi.com",
 -      "endpoint": "http://vk.com/ping.txt",
 +      "endpoint": "https://vk.com/ping.txt",
        "hash": "b5b607d573e6a901ef215db6b1247404c92bb9ce"
      },
      "mail.ru"
    ],
    "defaults": {
 -    "endpoint": "http://vk.com/ping.txt",
 +    "endpoint": "https://vk.com/ping.txt",
      "hash": "b5b607d573e6a901ef215db6b1247404c92bb9ce"
    }
  }
 }}}

--
Ticket URL: <https://trac.torproject.org/projects/tor/ticket/22369#comment:9>
Tor Bug Tracker & Wiki <https://trac.torproject.org/>
The Tor Project: anonymity online