us.codecraft.webmagic.samples.scheduler

Class LevelLimitScheduler

java.lang.Object

us.codecraft.webmagic.scheduler.DuplicateRemovedScheduler

us.codecraft.webmagic.scheduler.PriorityScheduler

us.codecraft.webmagic.samples.scheduler.LevelLimitScheduler

All Implemented Interfaces:

MonitorableScheduler, Scheduler

public class LevelLimitScheduler
extends PriorityScheduler

Author:

code4crafter@gmail.com

Field Summary

Fields inherited from class us.codecraft.webmagic.scheduler.PriorityScheduler

INITIAL_CAPACITY

Fields inherited from class us.codecraft.webmagic.scheduler.DuplicateRemovedScheduler

logger

Constructor Summary

Constructors

Constructor and Description
LevelLimitScheduler(int levelLimit)

Method Summary

Modifier and Type	Method and Description
void	push(Request request, Task task) add a url to fetch

Methods inherited from class us.codecraft.webmagic.scheduler.PriorityScheduler

getLeftRequestsCount, getTotalRequestsCount, poll, pushWhenNoDuplicate

Methods inherited from class us.codecraft.webmagic.scheduler.DuplicateRemovedScheduler

getDuplicateRemover, noNeedToRemoveDuplicate, setDuplicateRemover, shouldReserved

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

LevelLimitScheduler

public LevelLimitScheduler(int levelLimit)

Method Detail

push

public void push(Request request,
                 Task task)

Description copied from interface: Scheduler

add a url to fetch

Specified by:

push in interface Scheduler

Overrides:

push in class DuplicateRemovedScheduler

Parameters:

request - request

task - task