[tor-reports] OONI team status report for October 2014

[Arturo Filastò]

# What we did in October 2014

## ooniprobe

* We released ooniprobe 1.2.0 and 1.2.2 that include two new tools
oonideckgen and ooniresources making it possible to generate test decks
for a specific country.
For a full changelog see:
https://gitweb.torproject.org/ooni-probe.git/blob/HEAD:/ChangeLog.rst#l13
https://gitweb.torproject.org/ooni-probe.git/blob/HEAD:/ChangeLog.rst#l4

* Add some extra keys to the ooniprobe report output:
https://github.com/TheTorProject/ooni-spec/commit/73aa34f1123af603fab00d00b5cd1806c9152c45
https://github.com/TheTorProject/ooni-probe/commit/b59d9343354990a39a87fd6e7fe655c632117feb

## oonibackend

* Fix bug in backend:
https://github.com/TheTorProject/ooni-backend/commit/7e95433b66cb96b5c524a76c04da7251ae5d3a68

## oonipipeline

This is a new software component that deals with processing raw
ooniprobe reports, placing them in a database and exposing them to the web.

An overview of this software component can be found here:
https://github.com/TheTorProject/ooni-pipeline#ooni-pipeline

* Work on the script for putting the sanitised reports into the database
https://trac.torproject.org/projects/tor/ticket/13564

* Work on script that generates the data formats for visualisation team
https://trac.torproject.org/projects/tor/ticket/13565

* Sanitize .csv files
https://trac.torproject.org/projects/tor/ticket/12548

* Post process the data collected by the bridge DB collector
https://trac.torproject.org/projects/tor/ticket/12546

## Data visualisation

* Produce a prototype of the graphs for the bridge reachability study.

## Misc.

* Organise and attend a hackfest in berlin to bootstrap the bridge
reachability study.

* Meet with censorship researchers in NYC during an event organised by mlab.

# Next steps for November 2014

* Write scripts for generating the bridge_db.json document based on the
data that is given to us from the bridge db team
https://trac.torproject.org/projects/tor/ticket/13570

* Align the dates in the visual timeline
https://trac.torproject.org/projects/tor/ticket/13639

* Better tokenising for bridges so that bridges that have the same
  fingerprint, but different transport are grouped properly
https://trac.torproject.org/projects/tor/ticket/13638

* Finish setting up the docker containers for the steps of the data
  pipeline
https://trac.torproject.org/projects/tor/ticket/13568

* Setup disaster recovery procedure and backup:
https://trac.torproject.org/projects/tor/ticket/13584

* Setup monitoring of the probes.
https://trac.torproject.org/projects/tor/ticket/12549

* Add support for obfs4
https://trac.torproject.org/projects/tor/ticket/13597

* Set upper bound in comparison with the control in the bridge
reachability timeline
https://trac.torproject.org/projects/tor/ticket/13640