4. Basic crawler

In WebMagic, the basic realization of a crawler only need to write a class that implements PageProcessor interface. This class basically contains all the code to crawl a site, you need to write.

At the same time this section will describe how to use WebMagic extraction API, as well as the most common problem crawl save the results.

results matching ""

    No results matching ""