Uses of Interface
us.codecraft.webmagic.scheduler.component.DuplicateRemover

Packages that use DuplicateRemover

Package	Description
us.codecraft.webmagic.scheduler	Scheduler is the part of url management.
us.codecraft.webmagic.scheduler.component	Component of scheduler.

Uses of DuplicateRemover in us.codecraft.webmagic.scheduler

Classes in us.codecraft.webmagic.scheduler that implement DuplicateRemover

Modifier and Type	Class and Description
class	BloomFilterDuplicateRemover BloomFilterDuplicateRemover for huge number of urls.
class	RedisPriorityScheduler the redis scheduler with priority
class	RedisScheduler Use Redis as url scheduler for distributed crawlers.

Methods in us.codecraft.webmagic.scheduler that return DuplicateRemover

Modifier and Type	Method and Description
DuplicateRemover	DuplicateRemovedScheduler.getDuplicateRemover()

Methods in us.codecraft.webmagic.scheduler with parameters of type DuplicateRemover

Modifier and Type	Method and Description
DuplicateRemovedScheduler	DuplicateRemovedScheduler.setDuplicateRemover(DuplicateRemover duplicatedRemover)

Uses of DuplicateRemover in us.codecraft.webmagic.scheduler.component

Classes in us.codecraft.webmagic.scheduler.component that implement DuplicateRemover

Modifier and Type	Class and Description
class	HashSetDuplicateRemover