[tor-bugs] #17488 [ExoneraTor]: ExoneraTor hangs forever on old known-positive test

[Tor Bug Tracker & Wiki]

#17488: ExoneraTor hangs forever on old known-positive test
------------------------+--------------------------
 Reporter:  starlight   |          Owner:  karsten
     Type:  defect      |         Status:  accepted
 Priority:  Very High   |      Milestone:
Component:  ExoneraTor  |        Version:
 Severity:  Major       |     Resolution:
 Keywords:              |  Actual Points:
Parent ID:              |         Points:
  Sponsor:              |
------------------------+--------------------------

Comment (by karsten):

 {{{
 exonerator=> EXPLAIN ANALYZE
 exonerator->   SELECT statusentry.rawstatusentry,
 exonerator->         statusentry.descriptor,
 exonerator->         statusentry.validafter,
 exonerator->         statusentry.fingerprint,
 exonerator->         HOST(statusentry.oraddress),
 exonerator->         HOST(exitlistentry.exitaddress),
 exonerator->         -- Pick only the last scan result that took place in
 the 24 hours
 exonerator->         -- before the valid-after time.
 exonerator->         MAX(exitlistentry.scanned)
 exonerator->       FROM statusentry
 exonerator->       JOIN exitlistentry
 exonerator->       ON statusentry.fingerprint = exitlistentry.fingerprint
 exonerator->       WHERE exitlistentry.exitaddress = '98.113.149.36'::INET
 exonerator->       -- Focus on a time period from 1 day before and 1 day
 after the
 exonerator->       -- given date.  Also include a second day before the
 given date
 exonerator->       -- for exit lists, because it can take up to 24 hours
 to scan a
 exonerator->       -- relay again.  We shouldn't miss exit list entries
 here.
 exonerator->       AND DATE(exitlistentry.scanned) >= '2011-04-27'
 exonerator->       AND DATE(exitlistentry.scanned) <= '2011-04-30'
 exonerator->       AND DATE(statusentry.validafter) >= '2011-04-28'
 exonerator->       AND DATE(statusentry.validafter) <= '2011-04-30'
 exonerator->       GROUP BY 1, 2, 3, 4, 5, 6;
 QUERY PLAN
 --------------------------------------------------------------------------------------------------------------------------------------------------------------------
  HashAggregate  (cost=32395.69..32395.75 rows=4 width=342) (actual
 time=53974.565..53974.673 rows=72 loops=1)
    ->  Nested Loop  (cost=454.67..32395.62 rows=4 width=342) (actual
 time=10130.628..53972.490 rows=288 loops=1)
          ->  Index Scan using exitlistentry_exitaddress_scanneddate on
 exitlistentry  (cost=0.01..8.82 rows=1 width=56) (actual
 time=16.972..43.140 rows=4 loops=1)
                Index Cond: ((exitaddress = '98.113.149.36'::inet) AND
 (date(scanned) >= '2011-04-27'::date) AND (date(scanned) <=
 '2011-04-30'::date))
          ->  Bitmap Heap Scan on statusentry  (cost=454.66..32285.65
 rows=8090 width=327) (actual time=2538.725..13481.531 rows=72 loops=4)
                Recheck Cond: (fingerprint = exitlistentry.fingerprint)
                Filter: ((date(validafter) >= '2011-04-28'::date) AND
 (date(validafter) <= '2011-04-30'::date))
                ->  Bitmap Index Scan on statusentry_fingerprint_validafter
 (cost=0.00..454.66 rows=8090 width=0) (actual time=14.937..14.937
 rows=13735 loops=4)
                      Index Cond: (fingerprint = exitlistentry.fingerprint)
  Total runtime: 53974.888 ms
 (10 rows)
 }}}

--
Ticket URL: <https://trac.torproject.org/projects/tor/ticket/17488#comment:6>
Tor Bug Tracker & Wiki <https://trac.torproject.org/>
The Tor Project: anonymity online