| us.codecraft.webmagic |
Main class "Spider" and models.
|
| us.codecraft.webmagic.configurable |
|
| us.codecraft.webmagic.downloader |
Downloader is the part that downloads web pages and store in Page object.
|
| us.codecraft.webmagic.downloader.selenium |
|
| us.codecraft.webmagic.example |
|
| us.codecraft.webmagic.handler |
|
| us.codecraft.webmagic.main |
|
| us.codecraft.webmagic.model |
Page model and annotations used to customize a crawler.
|
| us.codecraft.webmagic.model.annotation |
Annotations for defining a extractor.
|
| us.codecraft.webmagic.model.formatter |
|
| us.codecraft.webmagic.model.samples |
|
| us.codecraft.webmagic.monitor |
|
| us.codecraft.webmagic.pipeline |
Pipeline is the persistent and offline process part of crawler.
|
| us.codecraft.webmagic.processor |
PageProcessor custom part of a crawler for specific site.
|
| us.codecraft.webmagic.processor.example |
|
| us.codecraft.webmagic.proxy |
|
| us.codecraft.webmagic.samples |
|
| us.codecraft.webmagic.samples.formatter |
|
| us.codecraft.webmagic.samples.pipeline |
|
| us.codecraft.webmagic.samples.scheduler |
|
| us.codecraft.webmagic.scheduler |
Scheduler is the part of url management.
|
| us.codecraft.webmagic.scheduler.component |
Component of scheduler.
|
| us.codecraft.webmagic.scripts |
|
| us.codecraft.webmagic.selector |
Selectors for page extraction.
|
| us.codecraft.webmagic.thread |
|
| us.codecraft.webmagic.utils |
Static utils of webmagic.
|