Uses of Class
us.codecraft.webmagic.Spider

Packages that use Spider

Package	Description
us.codecraft.webmagic	Main class "Spider" and models.
us.codecraft.webmagic.model	Page model and annotations used to customize a crawler.
us.codecraft.webmagic.monitor

Uses of Spider in us.codecraft.webmagic

Methods in us.codecraft.webmagic that return Spider

Modifier and Type	Method and Description
Spider	Spider.addPipeline(Pipeline pipeline) add a pipeline for Spider
Spider	Spider.addRequest(Request... requests) Add urls with information to crawl.
Spider	Spider.addUrl(String... urls) Add urls to crawl.
Spider	Spider.clearPipeline() clear the pipelines set
static Spider	Spider.create(PageProcessor pageProcessor) create a spider with pageProcessor.
Spider	Spider.downloader(Downloader downloader) Deprecated.
Spider	Spider.pipeline(Pipeline pipeline) Deprecated.
Spider	Spider.scheduler(Scheduler scheduler) Deprecated.
Spider	Spider.setDownloader(Downloader downloader) set the downloader of spider
Spider	Spider.setExecutorService(ExecutorService executorService)
Spider	Spider.setExitWhenComplete(boolean exitWhenComplete) Exit when complete.
Spider	Spider.setPipelines(List<Pipeline> pipelines) set pipelines for Spider
Spider	Spider.setScheduler(Scheduler scheduler) set scheduler for Spider
Spider	Spider.setSpawnUrl(boolean spawnUrl) Whether add urls extracted to download. Add urls to download when it is true, and just download seed urls when it is false.
Spider	Spider.setSpiderListeners(List<SpiderListener> spiderListeners)
Spider	Spider.setUUID(String uuid) Set an uuid for spider. Default uuid is domain of site.
Spider	Spider.startRequest(List<Request> startRequests) Set startUrls of Spider. Prior to startUrls of Site.
Spider	Spider.startUrls(List<String> startUrls) Set startUrls of Spider. Prior to startUrls of Site.
Spider	Spider.thread(ExecutorService executorService, int threadNum) start with more than one threads
Spider	Spider.thread(int threadNum) start with more than one threads

Uses of Spider in us.codecraft.webmagic.model

Subclasses of Spider in us.codecraft.webmagic.model

Modifier and Type	Class and Description
class	OOSpider<T> The spider for page model extractor. In webmagic, we call a POJO containing extract result as "page model".

Uses of Spider in us.codecraft.webmagic.monitor

Fields in us.codecraft.webmagic.monitor declared as Spider

Modifier and Type	Field and Description
protected Spider	SpiderStatus.spider

Methods in us.codecraft.webmagic.monitor with parameters of type Spider

Modifier and Type	Method and Description
protected SpiderStatusMXBean	SpiderMonitor.getSpiderStatusMBean(Spider spider, SpiderMonitor.MonitorSpiderListener monitorSpiderListener)
SpiderMonitor	SpiderMonitor.register(Spider... spiders) Register spider for monitor.

Constructors in us.codecraft.webmagic.monitor with parameters of type Spider

Constructor and Description
SpiderStatus(Spider spider, SpiderMonitor.MonitorSpiderListener monitorSpiderListener)