Introduction
WebMagic Overview
Philosophy
Architect
Components
Install
With maven
Without maven
First Project
Build From Source
Get the Source Code
Import Project
Build and run examples
Basic crawler
Implement PageProcessor
Selectable
Save the results
Config and control
Jsoup and Xsoup
Monitor with JMX
Crawler in Annotation
Write Model class
TargetUrl and HelpUrl
@ExtractBy
@ExtractBy on Class
Formatter of Result
A Complete Sample
AfterExtractor
Customize Components
Pipeline
Scheduler
Downloader
Case Study
The combination of basic page and list links
Front-end JS rendering page
Crawl page
Periodically crawl
Incremental Update
Published with GitBook
Philosophy
1.1 Philosophy
1. Solution for Domain
2. Mirco core with high flexibility
3. Convenient to Use
results matching "
"
No results matching "
"