public abstract class DuplicateRemovedScheduler extends Object implements Scheduler
Modifier and Type | Field and Description |
---|---|
protected org.slf4j.Logger |
logger |
Constructor and Description |
---|
DuplicateRemovedScheduler() |
Modifier and Type | Method and Description |
---|---|
DuplicateRemover |
getDuplicateRemover() |
protected boolean |
noNeedToRemoveDuplicate(Request request) |
void |
push(Request request,
Task task)
add a url to fetch
|
protected void |
pushWhenNoDuplicate(Request request,
Task task) |
DuplicateRemovedScheduler |
setDuplicateRemover(DuplicateRemover duplicatedRemover) |
protected boolean |
shouldReserved(Request request) |
public DuplicateRemover getDuplicateRemover()
public DuplicateRemovedScheduler setDuplicateRemover(DuplicateRemover duplicatedRemover)
public void push(Request request, Task task)
Scheduler
protected boolean shouldReserved(Request request)
protected boolean noNeedToRemoveDuplicate(Request request)
Copyright © 2017. All rights reserved.