Package | Description |
---|---|
us.codecraft.webmagic |
Main class "Spider" and models.
|
us.codecraft.webmagic.downloader |
Downloader is the part that downloads web pages and store in Page object.
|
us.codecraft.webmagic.downloader.selenium |
Modifier and Type | Field and Description |
---|---|
protected Downloader |
Spider.downloader |
Modifier and Type | Method and Description |
---|---|
Spider |
Spider.downloader(Downloader downloader)
Deprecated.
|
Spider |
Spider.setDownloader(Downloader downloader)
set the downloader of spider
|
Modifier and Type | Class and Description |
---|---|
class |
AbstractDownloader
Base class of downloader with some common methods.
|
class |
HttpClientDownloader
The http downloader based on HttpClient.
|
class |
PhantomJSDownloader
this downloader is used to download pages which need to render the javascript
|
Modifier and Type | Class and Description |
---|---|
class |
SeleniumDownloader
使用Selenium调用浏览器进行渲染。目前仅支持chrome。
需要下载Selenium driver支持。 |
Copyright © 2017. All rights reserved.