[tor-project] OONI Monthly Report: November 2023

[Maria Xynou]

Hello,

This email shares OONI's monthly report for November 2023.

*# OONI Monthly Report: November 2023*

Throughout November 2023, the OONI team worked on the following sprints:

* Sprint 103 (1st - 5th November 2023)
* Sprint 104 (6th - 19th November 2023)
* Sprint 105 (20th - 30th November 2023)

Our work can be tracked through the various OONI GitHub repositories:
https://github.com/ooni

Highlights are shared in this report below.

*## Launched the OONI Censorship Findings platform*

We are excited to share that we launched a new Censorship Findings platform!

Along with the launch, we published:

* 20 reports on censorship events that emerged in 2023:
https://explorer.ooni.org/findings

* Blog post sharing information about the Censorship Findings platform:
https://ooni.org/post/2023-launch-ooni-censorship-findings-platform/

The Censorship Findings platform was also featured as a “Tool of the Week”
in Top10VPN’s newsletter:
https://top10vpn.substack.com/p/friday-digest-4-fb-messenger-whatsapp

The Censorship Findings platform includes 20 reports on internet censorship
events that emerged around the world in 2023 based on OONI data. These
short reports include key censorship findings and charts based on OONI
data. We describe the criteria that inform which cases we report on in our
blog post:
https://ooni.org/post/2023-launch-ooni-censorship-findings-platform/#limitations

Our goal is to support research and advocacy efforts aimed at monitoring
and responding to internet censorship around the world. In response to
emergent censorship events, we will continue to publish reports on the
Censorship Findings platform on an ongoing basis.

We thank the global OONI community for contributing measurements, making
the creation of this platform possible.

*## OONI Team Meeting 2023*

Our team is distributed in various countries (and continents) and
throughout the year, we work remotely online. Once a year, we come together
for an in-person OONI Team Meeting to discuss projects, strategic
priorities, and to refine our roadmaps.

Between 8th-10th November 2023, we hosted our annual OONI Team Meeting in
Nairobi, Kenya.

We chose Nairobi as a location for our team meeting based on our script
which automatically provides locations that are visa-friendly, safe, and
cost-effective to help ensure in person attendance from all of our team
members. We took this measure because last year, half of our team was not
able to travel to Rome for our 2022 Team Meeting due to visa issues (and we
therefore had to host a hybrid event).

This year, hosting the meeting in Kenya meant that all of our team members
were able to join in person! And this meeting provided us the opportunity
to meet some of our colleagues in person for the first time! In addition to
our team, the meeting also included an OTF research fellow who we will be
hosting over the next year.

As part of the 3-day OONI Team Meeting 2023, we facilitated the following
15 sessions:

1) OONI Strategy: Now and in the Future
2) Automating censorship detection and characterization, and creating a
Social Media Censorship Alert System: Discussion of current status and next
steps
3) Community engagement and new community roadmap
4) Supporting richer testing input: Discussion of current status and next
steps
5) Presenting thematic censorship findings on OONI Explorer: Discussion of
current status and next steps
6) Measuring the blocking of VPNs and evolving circumvention games
7) Evolution of OONI measurement representations: Moving towards a flexible
architecture and data model for research and presentation
8) Methods for measuring throttling: Discussion of current status and next
steps
9) OONI Run v2: Discussion of current status and next steps towards launch
10) Team Health Check
11) Psychological safety and supportive group norms
12) Roadmap session (Part 1)
13) Roadmap session (Part 2)
14) OONI funds and finances for 2024
15) OONI fundraising priorities

As an outcome, we have significantly improved roadmaps, and we made
important progress on many of our high-priority projects and activities. We
also had an opportunity to discuss strategic priorities for the future, as
well as approaches for improving our team’s health and organization’s
long-term resilience.

On 11th November 2023 (after the 3-day team meeting), we hosted a “team
bonding day”, providing our team some extra time for in person bonding –
which is important given that we work remotely throughout the year.

*## Published blog post about IMC 2023 internet measurement hackathon*

In collaboration with ISOC, M-Lab, Censored Planet, and IODA, OONI
co-hosted an internet measurement hackathon alongside the Internet
Measurement Conference (IMC) 2023.

In November 2023, we published a blog post sharing the great projects that
came out of the hackathon: https://ooni.org/post/imc-hackathon-results-2023/

The hackathon participants worked on using OONI data to investigate IPv6
connectivity, data triangulation to infer censorship or shutdown events,
and on correlating alarms across multiple datasets. We were very impressed
with the results produced by the participants!

During the hackathon, OONI's Arturo created "The Sound of Internet
Shutdowns": a sonification project which transforms some of the features of
the IODA dataset into synthesized sounds: https://shutdown-sound.vercel.app/

Here is an example of how an internet shutdown in Iraq based on IODA data
sounds like: https://www.youtube.com/watch?v=Z1TFc1AyqI4

The "Sound of Internet Shutdowns" project was featured as a “Tool of the
Week” in Top10VPN’s newsletter:
https://top10vpn.substack.com/p/friday-digest-3-vpn-vulnerabilities

We thank all the participants and co-organizers for making the hackathon a
great event!

*## OONI Probe Mobile*

In November 2023, we released OONI Probe Mobile 3.8.5 for both Android (
https://github.com/ooni/probe-android/releases/tag/v3.8.5) and iOS (
https://github.com/ooni/probe-ios/releases/tag/v3.8.5), which included some
minor improvements and maintenance work.

*## OONI Run*

As part of our work on creating the next generation version of OONI Run
(“OONI Run v2”), we continued to iterate on the user interface designs for
the web and mobile applications. Most notably, we updated the run button
from the dashboard to display the new flow for selecting tests (
https://github.com/ooni/probe-android/pull/632) and we updated the
preferences to reflect the new designs (
https://github.com/ooni/probe-android/pull/633). We also started working on
our test plans to prepare for internal testing and QA next year.

Moreover, we added OONI Run link ID support (
https://github.com/ooni/backend/pull/768) and backend support for searching
measurements from a specific OONI Run v2 link (
https://github.com/ooni/backend/issues/701) to the fastpath pipeline.

*## OONI Probe CLI*

We released OONI Probe CLI versions 3.19.1 and 3.19.2 to address data
quality issues caused by changes in the endpoints used by the Signal
application. You can read the changelogs at the following links:

* https://github.com/ooni/probe-cli/releases/tag/v3.19.1
* https://github.com/ooni/probe-cli/releases/tag/v3.19.2

We also continued working on improving our throttling methodology by
merging work into the master branch (see the throttling section) and
starting to prepare for the OONI Probe CLI 3.20 release.

Our community has asked us to add support for Go 1.21, but unfortunately it
seems we will not be able to do that for OONI Probe 3.20. We will
nonetheless try our best to support Go 1.21 before Go 1.20 goes EOL in
February 2024. You can read more about this topic here:
https://github.com/ooni/probe/issues/2548

*## Expanding OONI’s testing model to support richer testing input*

As part of our OONI Team Meeting 2023 in Nairobi, we facilitated a session
on “supporting richer testing input”, as part of which we discussed the
current status and next steps. As part of this, we documented the next
milestones and improved upon our relevant roadmap. We illustrate the
updated plan in the following GitHub issue:
https://github.com/ooni/ooni.org/issues/1291

In summary, we aim to incrementally add richer testing input to the data
structure returned by the check-in API for the experiments that would
benefit the most from obtaining richer input.

Based on our current plan, the OONI experiments that would benefit most
from richer testing input include:

* DNS Check: Richer testing input would allow us to serve information about
HTTP/3 and start testing DNS-over-HTTP3.

* Signal: Richer testing input would enable us to serve the custom CA and
to measure the endpoints from the backend, thus eliminating the need to
make emergency releases (such as with OONI Probe CLI 3.19.1 and 3.19.2) to
handle endpoint changes.

*STUN Reachability: Richer testing input will allow us to serve the STUN
endpoints used by the snowflake client and to keep updating them without
making new releases.

* Tor Snowflake: Richer testing input will allow us to modify some
parameters used by snowflake to bootstrap and to reduce the number of cases
where we need to issue new bug-fixing releases.

* RiseupVPN: Richer testing input will allow us to eliminate the functional
coupling in the experiment implementation between checking for Riseup’s API
reachability and obtaining the endpoints to measure, thus making the
experiment more robust and adaptable.

* (Potentially) urlgetter:  Richer testing input will allow us to run
custom measurements when there is an emerging censorship condition for
which we don’t already have an experiment.

These changes will modify the OONI Probe client and, for some experiments,
we will take advantage of the new ooni/data processing pipeline (
https://github.com/ooni/data).

*## Creating a methodology for measuring throttling*

We already implemented better support for measuring throttling in Web
Connectivity v0.5, which is currently not enabled for most OONI Probe apps
users. To enable this experiment for everyone, we first need to make sure
that it is fully compatible with the current stable version (v0.4). That
is, if a website was previously marked as blocked in a specific way by
v0.4, we would like v0.5 to say the same. We would also like v0.5 to
provide a more nuanced view of the blocking that is happening, but we
definitely don’t want to introduce data quality issues.

During November 2023, we made significant progress to make this happen.
Specifically, we ran A/B testing between Web Connectivity v0.5 and v0.4
using our Gvisor-based QA suite. As part of this work, we wrestled with the
difficulty of mapping the results produced by v0.5 to the ones produced by
v0.4. The underpinning issue is that v0.5 results answer the question of
“all the ways in which the tested website is blocked.” Conversely, v0.4
analysis code aims to answer the question of “the first way in which the
website is blocked.” To reconcile these differences, we needed to
significantly enrich our in-probe data processing capabilities.

To this end, we authored a new Go package named “minipipeline.” We
implemented this package to mirror the data analysis architecture
implemented in the new ooni/data processing pipeline (
https://github.com/ooni/data). The general idea is that an OONI measurement
(i.e., the piece of JSON OONI Probe sends to the backend and you can
inspect in Explorer) goes through the following set of standard
transformations:

1) We process the fundamental results inside the measurement (e.g., the
results of DNS lookups, TCP connects, TLS handshakes) to produce flat
“observations.” Each observation is a statement about measurements
performed by OONI Probe with a single possible failure. In other words,
each DNS lookup produces an observation, and each attempt at measuring an
endpoint (e.g., “8.8.8.8:443” with SNI equal to “dns.google”) is also an
observation. We also link DNS and endpoints observations together, take
note of the redirect depth (i.e., is this the first request or the N-th
redirect?), and distinguish between observations that aim to fetch a
webpage and observations that just enrich the measurement.

2) We analyze the observations to produce a synthetic representation called
“analysis,” which contains metrics such as (a) which DNS lookups failed
where we expected them to succeed based on the control measurement and (b)
the linear list of operations performed to fetch the final webpage, sorted
by descending redirect depth, type, and result.

In turn, Web Connectivity v0.5 uses the “analysis” results to produce its
top-level keys (e.g., the blocking and accessible fields also produced by
Web Connectivity v0.4).

Thanks to this more comprehensive and more accurate measurement analysis
process, and by filtering observations to only include into the analysis
those observations that would also be produced by v0.4, we’re now able to
obtain the same documented top-level test keys in v0.4 and v0.5 for all the
test cases defined in our GVisor-based QA suite.

This result is a significant milestone for us, because it means we can
start running A/B testing in production using existing probes once the new
code has been shipped. The aim of this further A/B testing stage would be
to collect real world data that is useful to compare v0.4 and v0.5,
possibly leading to additional bug fixes and new QA test cases.

Additionally, from the engineering perspective, using a similar data
processing architecture between OONI Probe and the ooni/data pipeline
enables running A/B testing between the two tools in the future, and
potentially opens up the possibility of sharing code between them.

*## OONI Explorer*

As part of our OONI Team Meeting 2023 in Nairobi, we facilitated a session
on “presenting thematic censorship findings on OONI Explorer”. As part of
this session, we discussed the challenges associated with grouping OONI
measurements by resource and presenting thematic censorship findings (while
eliminating the risk of false positives) in an automated way. We also
discussed and determined the next steps towards implementing this area of
work over the next months.

In November 2023, we also launched the new Censorship Findings (
https://explorer.ooni.org/findings) page on OONI Explorer (as discussed
previously in this report).

*## Creating a Social Media Censorship Alert System*

As part of our OONI Team Meeting 2023 in Nairobi, we facilitated a session
on “creating a Social Media Censorship Alert System”. As part of this, our
colleagues presented the current status of the alert system, and we
discussed related challenges and next steps.

*## Automating censorship detection and characterization based on OONI
measurements*

In November 2023, we made significant progress in the area of automating
the detection and characterization of internet censorship.

Specifically, we came up with a new metric for representing the outcomes
related to blocking happening, called the Likelihood of Network
Interference (LoNI). This metric represents the likelihood that access to a
given resource is being restricted via a particular method within the
specified network region over some period of time.

The LoNI metric is implemented through a new data model called Experiment
Results. The analysis code of ooni/data (https://github.com/ooni/data) has
been significantly refactored to generate Experiment Results through an
intermediate data model called Analysis. The basic idea is to take the
Analysis keys that are generated by comparing an individual observation
with ground truth data. Through a very large set of rules we are able to
assign individual blocking, down and ok rules based on how confident we are
in that particular signal being a sign for censorship.

We then take all the scores pertaining to a particular observation group
relevant to a measurement and generate a MeasurementExperimentResult which
should be backward compatible with our existing data model. In terms of
performance, some cursory benchmarks were run on the dataset from
2023-09-01 to 2023-11-01 and it was processing data at a rate of ~7k
observations per second, scaling on 34 cores.

As part of our work (https://github.com/ooni/data/pull/44), we:
* Implemented the Experiment Result generation based on the analysis tables;
* Implemented minimal UI for MeasurementExperimentResult;
* Added support for generating MeasurementExperimentResult as part of
mkanalysis cli command;
* Added more tests for all of the above.

Moreover, we implemented a basic web interface for exploring these
Experiment results (https://github.com/ooni/data/pull/43). We started
working on creating a fastapi based HTTP API to expose this data to other
OONI services, such as OONI Explorer (https://github.com/ooni/data/pull/45).
We also wrote a minimal PoC that makes use of the backward compatible
aggregation API that is using the new LoNI based experiment results (
https://github.com/ooni/explorer/pull/892).

*## Preparing OONI backend documentation*

In November 2023, we started working towards writing OONI backend
documentation that describes the architecture of the main components of
OONI infrastructure. Specifically, we focused on improving the
documentation of our backend architecture, data flows, and deployment
workflows.

You can see a work in progress of the documentation here:
https://github.com/ooni/backend-documentation/blob/main/backend_documentation.md

*## Published OONI Outreach Kit in French and Spanish*

The OONI Outreach Kit is now available in both French and Spanish (in
addition to Russian and English)!

* French OONI Outreach Kit: https://ooni.org/fr/support/ooni-outreach-kit/
* Spanish OONI Outreach Kit: https://ooni.org/es/support/ooni-outreach-kit/

We thank our partner, Computech Institute (
https://ooni.org/partners/computech/) for the French translation, and we
thank OONI community members, Mariengracia Chirinos and Katherine
Pennachio, for the Spanish translation.

We hope that the French and Spanish versions of the OONI Outreach Kit will
help support OONI community engagement efforts!

*## Published OONI Risks documentation in Burmese*

The OONI Risks documentation is now available in Burmese:
https://ooni.org/my/about/risks

We thank the community members who translated this documentation to
Burmese. We generally consider it important to have this documentation
translated in as many languages as possible (particularly in languages
spoken in high-risk countries), as it communicates the potential risks
associated with running OONI Probe.

The OONI Risks documentation (https://ooni.org/about/risks/) is also
available in Arabic, Farsi, French, Russian, Spanish, and Swahili.

*## Creating OONI Community Interview videos*

In previous months, we interviewed community members so that they can share
their work and their experience with using OONI tools and data. The goal of
these interviews is to share how community members around the world make
use of OONI tools and data as part of their work. As an outcome, we hope
that such interviews will encourage others to use OONI tools too, and that
our community members will receive more support for their important work.

Throughout November 2023, we collaborated with a videographer on editing
footage for OONI community interviews. Specifically, we worked on multiple
rounds of video edits and iterations towards producing final short videos
(based on lengthy footage).



*## Rapid response efforts### Kenya blocked Telegram during KCSE 2023 exams*

On 16th November 2023, we were notified by our community that access to
Telegram was intermittently blocked in Kenya. We analyzed OONI data and
rapidly responded on Twitter, where we shared OONI data findings and
charts: https://twitter.com/OpenObservatory/status/1725202738370290053

We were surprised by this block, as this was the first time that we
observed the blocking of a popular instant messaging app in Kenya.

Overall, OONI data shows intermittent signs of Telegram blocking on several
networks in Kenya between 8th to 24th November 2023. The timings of the
blocks correlate with the timings of the KCSE 2023 exams. However, it’s
worth noting that the block did not appear to be implemented on all
networks, as OONI data shows that Telegram was accessible on many other
networks in Kenya in November 2023. Out of all tested networks, Jambonet
appears to have implemented the heaviest restrictions, as Telegram appears
to have been consistently blocked since 8th November 2023. Interestingly,
OONI data only shows signs of Telegram blocking until 24th November 2023,
which was the last day of the KCSE 2023 exams.

We also reported on this case on the OONI Censorship Findings platform:
https://explorer.ooni.org/findings/228466228201

*### Guinea blocked WhatsApp, Telegram, Facebook, Twitter, Instagram, and
YouTube*

As of 24th November 2023, OONI data suggests that some ISPs in Guinea
started blocking access to WhatsApp, Telegram, Facebook, Twitter,
Instagram, and YouTube. OONI data shows that the blocks appear to be
implemented by means of TLS interference.

On 27th November 2023, we responded to this block by sharing relevant OONI
data findings and charts on Twitter:
https://twitter.com/OpenObservatory/status/1729105525437346052

We also reported on this case on the OONI Censorship Findings platform:
https://explorer.ooni.org/findings/296303006301

Recent OONI data suggests that these blocks remain ongoing.

*### Nepal blocked TikTok*

In late November 2023, we were notified by our community that access to
TikTok was blocked in Nepal. We immediately responded by making a public
call for OONI Probe testing (sharing relevant testing instructions) on
Twitter: https://twitter.com/OpenObservatory/status/1729499672694161890

We subsequently published a report on the OONI Censorship Findings
platform, documenting the blocking of TikTok in Nepal based on OONI data:
https://explorer.ooni.org/findings/112092297601

OONI data only shows signs of TikTok blocking in Nepal between 24th to 29th
November 2023.



*## Community use of OONI data### Access Now’s press statement on the
blocking of Telegram in Kenya*

In response to the blocking of Telegram in Kenya, Access Now published a
press statement which cites OONI data:
https://www.accessnow.org/press-release/telegram-kenya-connected-national-exams/



*## Community activities### OONI training for human rights defenders in the
DRC*

Between 15th-17th November 2023, OONI’s Maria and Arturo facilitated an
online OONI training for human rights defenders and journalists in the
Democratic Republic of Congo (DRC).

This training was organized by Partenariat pour la Protection Integree
(PPI) and the Integrated Refugee Organization (IRO), and it included 2 OONI
training programmes for 2 groups of human rights defenders and journalists
from the DRC. We were initially intending to travel to Kinshasa to
facilitate a week-long training in person, but we unfortunately were unable
to due to visa issues. As a result, we adapted the training programme
accordingly and facilitated it entirely online.

As part of this online training, we facilitated the following OONI sessions
(twice each for 2 groups):

* Introduction to OONI
* Using OONI Probe and OONI Run: Hands-on workshop
* Updating the DRC test list: Hands-on workshop
* Using OONI Explorer: Hands-on workshop

As part of these sessions, we provided relevant online presentations,
followed by Q&A and hands-on exercises. Due to connectivity issues, we also
created videos for each of the above sessions to enable the participants to
watch the presentations without internet connectivity. To create the
videos, we wrote 4 scripts (one for each session) and we automatically
converted the scripts to French, which were read as part of the videos.
That way, participants were able to watch the video presentations in
French. We also followed up with the participants and organizers to share
the training surveys and relevant resources for further learning.

*### OONI presentation at RIPE 87*

On 28th November 2023, OONI’s Arturo presented the Measurement Aggregation
Toolkit (MAT) as part of a presentation (“Measuring Internet Censorship
with OONI”) at RIPE 87 in Rome, Italy. Information about the event is
available here: https://ripe87.ripe.net/programme/meeting-plan/mat-wg/

*### OONI Community Meeting*

On 28th November 2023, we hosted the monthly OONI Community Meeting on our
Slack channel (https://slack.ooni.org/), during which we shared OONI
updates from the past month, and we discussed our thoughts for improving
future OONI community meetings. As part of this discussion, we asked
participants to share their thoughts and feedback on how we can improve the
structure and format of future OONI community meetings to help make them as
useful as possible to the community.

*## Measurement coverage*

In November 2023, 48,336,322 OONI Probe measurements were collected from
3,134 networks in 174 countries around the world.

This information can also be found through our measurement stats on OONI
Explorer (see chart on “monthly coverage worldwide”):
https://explorer.ooni.org/

~ OONI team.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.torproject.org/pipermail/tor-project/attachments/20231212/e7db7d78/attachment-0001.htm>