4. Basic crawler

In WebMagic, the basic realization of a crawler only need to write a class that implements PageProcessor interface. This class basically contains all the code to crawl a site, you need to write.

At the same time this section will describe how to use WebMagic extraction API, as well as the most common problem crawl save the results.