Package | Description |
---|---|
us.codecraft.webmagic |
Main class "Spider" and models.
|
us.codecraft.webmagic.configurable | |
us.codecraft.webmagic.example | |
us.codecraft.webmagic.handler | |
us.codecraft.webmagic.model |
Page model and annotations used to customize a crawler.
|
us.codecraft.webmagic.processor |
PageProcessor custom part of a crawler for specific site.
|
us.codecraft.webmagic.processor.example | |
us.codecraft.webmagic.samples | |
us.codecraft.webmagic.samples.scheduler | |
us.codecraft.webmagic.scripts |
Modifier and Type | Field and Description |
---|---|
protected PageProcessor |
Spider.pageProcessor |
Modifier and Type | Method and Description |
---|---|
static Spider |
Spider.create(PageProcessor pageProcessor)
create a spider with pageProcessor.
|
Constructor and Description |
---|
Spider(PageProcessor pageProcessor)
create a spider with pageProcessor.
|
Modifier and Type | Class and Description |
---|---|
class |
ConfigurablePageProcessor |
Modifier and Type | Class and Description |
---|---|
class |
GithubRepoPageMapper |
Modifier and Type | Class and Description |
---|---|
class |
CompositePageProcessor |
Constructor and Description |
---|
OOSpider(PageProcessor pageProcessor) |
Modifier and Type | Class and Description |
---|---|
class |
SimplePageProcessor
A simple PageProcessor.
|
Modifier and Type | Class and Description |
---|---|
class |
BaiduBaikePageProcessor |
class |
GithubRepoPageProcessor |
class |
ZhihuPageProcessor |
Modifier and Type | Class and Description |
---|---|
class |
AlexanderMcqueenGoodsProcessor |
class |
AmanzonPageProcessor |
class |
AngularJSProcessor |
class |
DiandianBlogProcessor |
class |
DiaoyuwengProcessor |
class |
F58PageProcesser |
class |
HuxiuProcessor |
class |
InfoQMiniBookProcessor |
class |
IteyeBlogProcessor |
class |
KaichibaProcessor |
class |
MamacnPageProcessor |
class |
MeicanProcessor |
class |
NjuBBSProcessor |
class |
PhantomJSPageProcessor
Created by dolphineor on 2014-11-21.
|
class |
QzoneBlogProcessor |
class |
SinaBlogProcessor |
class |
TianyaPageProcesser |
Modifier and Type | Class and Description |
---|---|
class |
ZipCodePageProcessor |
Modifier and Type | Class and Description |
---|---|
class |
ScriptProcessor |
Copyright © 2017. All rights reserved.