public abstract class DuplicateRemovedScheduler extends Object implements Scheduler
| Modifier and Type | Field and Description |
|---|---|
protected org.slf4j.Logger |
logger |
| Constructor and Description |
|---|
DuplicateRemovedScheduler() |
| Modifier and Type | Method and Description |
|---|---|
DuplicateRemover |
getDuplicateRemover() |
protected boolean |
noNeedToRemoveDuplicate(Request request) |
void |
push(Request request,
Task task)
add a url to fetch
|
protected void |
pushWhenNoDuplicate(Request request,
Task task) |
DuplicateRemovedScheduler |
setDuplicateRemover(DuplicateRemover duplicatedRemover) |
protected boolean |
shouldReserved(Request request) |
public DuplicateRemover getDuplicateRemover()
public DuplicateRemovedScheduler setDuplicateRemover(DuplicateRemover duplicatedRemover)
public void push(Request request, Task task)
Schedulerprotected boolean shouldReserved(Request request)
protected boolean noNeedToRemoveDuplicate(Request request)
Copyright © 2017. All rights reserved.