us.codecraft.webmagic.pipeline

Class FilePipeline

java.lang.Object

us.codecraft.webmagic.utils.FilePersistentBase

us.codecraft.webmagic.pipeline.FilePipeline

All Implemented Interfaces:

Pipeline

@ThreadSafe
public class FilePipeline
extends FilePersistentBase
implements Pipeline

Store results in files.

Since:

0.1.0

Author:

code4crafter@gmail.com

Field Summary

Fields inherited from class us.codecraft.webmagic.utils.FilePersistentBase

path, PATH_SEPERATOR

Constructor Summary

Constructors

Constructor and Description
FilePipeline() create a FilePipeline with default path"/data/webmagic/"
FilePipeline(String path)

Method Summary

Modifier and Type	Method and Description
void	process(ResultItems resultItems, Task task) Process extracted results.

Methods inherited from class us.codecraft.webmagic.utils.FilePersistentBase

checkAndMakeParentDirecotry, getFile, getPath, setPath

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

FilePipeline

public FilePipeline()

create a FilePipeline with default path"/data/webmagic/"

FilePipeline

public FilePipeline(String path)

Method Detail

process

public void process(ResultItems resultItems,
                    Task task)

Description copied from interface: Pipeline

Process extracted results.

Specified by:

process in interface Pipeline

Parameters:

resultItems - resultItems

task - task