| Package | Description |
|---|---|
| us.codecraft.webmagic |
Main class "Spider" and models.
|
| us.codecraft.webmagic.configurable | |
| us.codecraft.webmagic.example | |
| us.codecraft.webmagic.handler | |
| us.codecraft.webmagic.model |
Page model and annotations used to customize a crawler.
|
| us.codecraft.webmagic.processor |
PageProcessor custom part of a crawler for specific site.
|
| us.codecraft.webmagic.processor.example | |
| us.codecraft.webmagic.samples | |
| us.codecraft.webmagic.samples.scheduler | |
| us.codecraft.webmagic.scripts |
| Modifier and Type | Field and Description |
|---|---|
protected PageProcessor |
Spider.pageProcessor |
| Modifier and Type | Method and Description |
|---|---|
static Spider |
Spider.create(PageProcessor pageProcessor)
create a spider with pageProcessor.
|
| Constructor and Description |
|---|
Spider(PageProcessor pageProcessor)
create a spider with pageProcessor.
|
| Modifier and Type | Class and Description |
|---|---|
class |
ConfigurablePageProcessor |
| Modifier and Type | Class and Description |
|---|---|
class |
GithubRepoPageMapper |
| Modifier and Type | Class and Description |
|---|---|
class |
CompositePageProcessor |
| Constructor and Description |
|---|
OOSpider(PageProcessor pageProcessor) |
| Modifier and Type | Class and Description |
|---|---|
class |
SimplePageProcessor
A simple PageProcessor.
|
| Modifier and Type | Class and Description |
|---|---|
class |
BaiduBaikePageProcessor |
class |
GithubRepoPageProcessor |
class |
ZhihuPageProcessor |
| Modifier and Type | Class and Description |
|---|---|
class |
AlexanderMcqueenGoodsProcessor |
class |
AmanzonPageProcessor |
class |
AngularJSProcessor |
class |
DiandianBlogProcessor |
class |
DiaoyuwengProcessor |
class |
F58PageProcesser |
class |
HuxiuProcessor |
class |
InfoQMiniBookProcessor |
class |
IteyeBlogProcessor |
class |
KaichibaProcessor |
class |
MamacnPageProcessor |
class |
MeicanProcessor |
class |
NjuBBSProcessor |
class |
PhantomJSPageProcessor
Created by dolphineor on 2014-11-21.
|
class |
QzoneBlogProcessor |
class |
SinaBlogProcessor |
class |
TianyaPageProcesser |
| Modifier and Type | Class and Description |
|---|---|
class |
ZipCodePageProcessor |
| Modifier and Type | Class and Description |
|---|---|
class |
ScriptProcessor |
Copyright © 2017. All rights reserved.