[tor-dev] stem

[Damian Johnson]

> Hi, Damian, thanks. I am happy to discuss it on tor-dev at . But I want to keep
> off spam, which some of my questions at first may be, essentially Qs. But,
> if you think they would be of interest to tor-dev, or others could help,
> just let me know, and i will sign up for it.

They certainly are! If you're interested in tor and development then I
would definitely suggest being on that list. Including it for this
thread.

> I am trying to figure out how to pull in the nodes that are actually used in
> my Tor circuits. They are the nodes reflected in the Network map function.

You want the get_circuits() method. As you mentioned the 'path'
attribute has the relays in your present circuits...

https://stem.torproject.org/api/control.html#stem.control.Controller.get_circuits

> I have created a MySql DB of some of my Tor circuits and nodes which i am
> analyzing. I grabbed 48 circuits with their 144 nodes and info (IP address,
> nickname, country) manually from my laptop's Tor network map.

That certainly sounds painful. The circuit paths will provide the
relay fingerprints which you can use for get_network_status() to get
the address, nickname, ORPort, etc...

https://stem.torproject.org/api/control.html#stem.control.Controller.get_network_status

As for locales that would be done via get_info('ip-to-country/<address>')...

https://gitweb.torproject.org/torspec.git/blob/HEAD:/control-spec.txt#l672

> ... and ultimately to AS and country.

AS will require the Maxmind AS database or something else. I know that
Onionoo includes the AS information so the options that come to mind
are either to (a) see how it does it or (b) query Onionoo for this
information.

https://onionoo.torproject.org/

> And i have read much of the control-spec, don't know how much is out of date

The control-spec should be up to date. If there are any inaccuracies
then please let us know!

Did you have any other questions? -Damian

On Mon, Jun 10, 2013 at 4:44 AM, SARAH CORTES <sarah at lewis.is> wrote:
> Hi, Damian, thanks. I am happy to discuss it on tor-dev at . But I want to keep
> off spam, which some of my questions at first may be, essentially Qs. But,
> if you think they would be of interest to tor-dev, or others could help,
> just let me know, and i will sign up for it.
>
> For example, I am trying to figure out how to pull in the nodes that are
> actually used in my Tor circuits. They are the nodes reflected in the
> Network map function. I have read your fine stem tutorials, it is so
> impressive you have dome so much work and documentation on your own
> initiative. It is certainly a huge help to me and otter researchers like me.
>
> I have created a MySql DB of some of my Tor circuits and nodes which i am
> analyzing. I grabbed 48 circuits with their 144 nodes and info (IP address,
> nickname, country) manually from my laptop's Tor network map. I am analyzing
> their country, so I am seeking to map nickname or fingerprint of the node to
> IP address and ultimately to AS and country. Ultimately, I am analyzing
> jurisdictional arbitrage and the hostility factors of differ countries to
> Tor traffic, and whether it is possible to incorporate country or AS in to
> the Tor path algorithm.
>
> I can see the entry guard nicknames and fingerprints in my state file and
> pick them up there, if necessary. Wish i could just edit the logs to display
> all nodes, then figure out how to map the node fingerprint or nickname to
> its IP address them AS and country. I understand there is a Tor atlas
> function but have not read it carefully yet.
>
> I have read documentation on the contents of the consensus file, the
> descriptors, geoip and state files, and played around with them a bit to
> understand them. I grasp that a fingerprint is a hash of the node's public
> key, and one or both of which seem to be the most reliable ID for a node.
>
> I can see from your documentation that variable path(nickname, fingerprint)
> contains the data i want. Just need to be able to get that data easily. Not
> sure if editing my torrc file is the way or what. If you have any
> suggestions, they are much appreciated.
>
> And i have read much of the control-spec, don't know how much is out of date
> https://gitweb.torproject.org/torspec.git/blob/HEAD:/control-spec.txt
>
> I have read this on modifying torrc, and played around with modifying torrc,
> on an elementary basis:
> https://www.torproject.org/docs/faq.html.en#torrc
>
> and some tickets on modifying torrc
> https://trac.torproject.org/projects/tor/ticket/6147
>
> and what I believe is your excellent documentation on stem events;
> https://stem.torproject.org/api/response.html#stem.response.events.BandwidthEvent
>
>
>
>
>
>
>
> On Jun 8, 2013, at 2:31 PM, Damian Johnson <atagar at torproject.org> wrote:
>
> Hi Sarah. Yup, I'd be more than happy to help if you have any stem
> questions. Email would definitely be better since we look to keep
> missing each other on irc. I'd appreciate it though if we discussed it
> on the tor-dev@ email list...
>
> https://lists.torproject.org/cgi-bin/mailman/listinfo/tor-dev
>
> On Sat, Jun 8, 2013 at 3:42 AM, SARAH CORTES <sarah at lewis.is> wrote:
>
> Hi Damian, I'm Sarah Cortes, a researcher. I tried you on irc on #tor-dev
> but was unable to reach you. We met at the tor dev meeting which i attended
> in March. I have some Qs for you regarding stem. Please let me know if you
> are available, thanks
>
>