gov.nasa.pds.validate.crawler
Class Crawler

java.lang.Object
  extended by gov.nasa.pds.validate.crawler.Crawler
Direct Known Subclasses:
FileCrawler, URLCrawler

public abstract class Crawler
extends Object


Field Summary
protected  FileFilter directoryFilter
          A directory filter.
protected  org.apache.commons.io.filefilter.IOFileFilter fileFilter
          A file filter.
protected  boolean getDirectories
          Flag to indicate whether to retrieve directory listings.
 
Constructor Summary
Crawler(boolean getDirectories, List<String> fileFilters)
           
 
Method Summary
abstract  List<Target> crawl(URL url)
           
 
Methods inherited from class java.lang.Object
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait
 

Field Detail

fileFilter

protected org.apache.commons.io.filefilter.IOFileFilter fileFilter
A file filter.


directoryFilter

protected FileFilter directoryFilter
A directory filter.


getDirectories

protected boolean getDirectories
Flag to indicate whether to retrieve directory listings.

Constructor Detail

Crawler

public Crawler(boolean getDirectories,
               List<String> fileFilters)
Method Detail

crawl

public abstract List<Target> crawl(URL url)
                            throws IOException
Throws:
IOException


Copyright © 2010–2014 Planetary Data System. All rights reserved.