us.codecraft.webmagic.pipeline

Class FilePageModelPipeline

java.lang.Object

us.codecraft.webmagic.utils.FilePersistentBase

us.codecraft.webmagic.pipeline.FilePageModelPipeline

All Implemented Interfaces:

PageModelPipeline

public class FilePageModelPipeline
extends FilePersistentBase
implements PageModelPipeline

Store results objects (page models) to files in plain format.
Use model.getKey() as file name if the model implements HasKey.
Otherwise use SHA1 as file name.

Since:

0.3.0

Author:

code4crafter@gmail.com

Field Summary

Fields inherited from class us.codecraft.webmagic.utils.FilePersistentBase

path, PATH_SEPERATOR

Constructor Summary

Constructors

Constructor and Description
FilePageModelPipeline() new JsonFilePageModelPipeline with default path "/data/webmagic/"
FilePageModelPipeline(String path)

Method Summary

Modifier and Type	Method and Description
void	process(Object o, Task task)

Methods inherited from class us.codecraft.webmagic.utils.FilePersistentBase

checkAndMakeParentDirecotry, getFile, getPath, setPath

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

FilePageModelPipeline

public FilePageModelPipeline()

new JsonFilePageModelPipeline with default path "/data/webmagic/"

FilePageModelPipeline

public FilePageModelPipeline(String path)

Method Detail

process

public void process(Object o,
                    Task task)

Specified by:

process in interface PageModelPipeline