gov.nasa.pds.validate.crawler
Class URLCrawler

java.lang.Object
  extended by gov.nasa.pds.validate.crawler.Crawler
      extended by gov.nasa.pds.validate.crawler.URLCrawler

public class URLCrawler
extends Crawler

Class to crawl a resource.

Author:
mcayanan

Field Summary
 
Fields inherited from class gov.nasa.pds.validate.crawler.Crawler
directoryFilter, fileFilter, getDirectories
 
Constructor Summary
URLCrawler(boolean getDirectories, List<String> fileFilters)
          Constructor.
 
Method Summary
 List<Target> crawl(URL url)
           
 
Methods inherited from class java.lang.Object
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait
 

Constructor Detail

URLCrawler

public URLCrawler(boolean getDirectories,
                  List<String> fileFilters)
Constructor.

Parameters:
getDirectories - Flag to indicate whether to retrieve directory listings.
fileFilters - A list of file filters to use when traversing a directory url.
Method Detail

crawl

public List<Target> crawl(URL url)
                   throws IOException
Specified by:
crawl in class Crawler
Throws:
IOException


Copyright © 2010-2014 Planetary Data System. All Rights Reserved.