~abentley/bzrtools/bzrtools.dev

« back to all changes in this revision

Viewing changes to bzrtools.py

  • Committer: Aaron Bentley
  • Date: 2006-03-25 06:08:01 UTC
  • Revision ID: aaron.bentley@utoronto.ca-20060325060801-eb4909f92e6e9adc
Tweakage of the apache scraper

Show diffs side-by-side

added added

removed removed

Lines of Context:
316
316
        url = match.group(1)
317
317
        if url.startswith('http://') or url.startswith('/') or '../' in url:
318
318
            continue
 
319
        if '?' in url:
 
320
            continue
319
321
        yield url.rstrip('/')
320
322
 
321
323
 
362
364
                subt = t.clone(directory)
363
365
            except UnicodeDecodeError:
364
366
                continue
365
 
            for bzrdir in iter_bzrdirs(subt):
 
367
            for bzrdir in iter_bzrdirs(subt, lister):
366
368
                yield bzrdir
367
369
    except (NoSuchFile, PermissionDenied, TransportError):
368
370
        pass