Package | Description |
---|---|
us.codecraft.webmagic.pipeline |
Pipeline is the persistent and offline process part of crawler.
|
us.codecraft.webmagic.samples.pipeline |
Modifier and Type | Class and Description |
---|---|
class |
FilePageModelPipeline
Store results objects (page models) to files in plain format.
Use model.getKey() as file name if the model implements HasKey. Otherwise use SHA1 as file name. |
class |
FilePipeline
Store results in files.
|
class |
JsonFilePageModelPipeline
Store results objects (page models) to files in JSON format.
Use model.getKey() as file name if the model implements HasKey. Otherwise use SHA1 as file name. |
class |
JsonFilePipeline
Store results to files in JSON format.
|
Modifier and Type | Class and Description |
---|---|
class |
OneFilePipeline |
Copyright © 2017. All rights reserved.