[tor-bugs] #6450 [Metrics Utilities]: Task #6329 Python script can't encode unicode characters

[Tor Bug Tracker & Wiki]

#6450: Task #6329 Python script can't encode unicode characters
-------------------------------+--------------------------------------------
 Reporter:  karsten            |          Owner:     
     Type:  defect             |         Status:  new
 Priority:  minor              |      Milestone:     
Component:  Metrics Utilities  |        Version:     
 Keywords:                     |         Parent:     
   Points:                     |   Actualpoints:     
-------------------------------+--------------------------------------------

Comment(by karsten):

 Replying to [comment:1 delber]:
 > If you look at every '\\\u' present in details.json, you notice that
 most of them are placeholders for badly parsed characters. I think the
 problem probably lies within Onionoo (or even Tor itself). Are strings
 supposed to be UTF-8 encoded? What should Onionoo do when the strings are
 not valid UTF-8?

 Onionoo adds these characters after looking them up in Maxmind's GeoIP or
 ASN database.  Onionoo's response is supposed to be UTF-8 encoded.  But
 when you request something from Onionoo, you receive a Unicode string?  I
 wonder if that's the problem here.

-- 
Ticket URL: <https://trac.torproject.org/projects/tor/ticket/6450#comment:3>
Tor Bug Tracker & Wiki <https://trac.torproject.org/>
The Tor Project: anonymity online