us.codecraft.webmagic.proxy

Class SimpleProxyProvider

java.lang.Object

us.codecraft.webmagic.proxy.SimpleProxyProvider

All Implemented Interfaces:

ProxyProvider

public class SimpleProxyProvider
extends Object
implements ProxyProvider

A simple ProxyProvider. Provide proxy as round-robin without heartbeat and error check. It can be used when all proxies are stable.

Since:

0.7.0

Author:

code4crafter@gmail.com Date: 17/4/16 Time: 10:18

Constructor Summary

Constructors

Constructor and Description
SimpleProxyProvider(List<Proxy> proxies)

Method Summary

Modifier and Type	Method and Description
static SimpleProxyProvider	from(Proxy... proxies)
Proxy	getProxy(Task task) Get a proxy for task by some strategy.
void	returnProxy(Proxy proxy, Page page, Task task) Return proxy to Provider when complete a download.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

SimpleProxyProvider

public SimpleProxyProvider(List<Proxy> proxies)

Method Detail

from

public static SimpleProxyProvider from(Proxy... proxies)

returnProxy

public void returnProxy(Proxy proxy,
                        Page page,
                        Task task)

Description copied from interface: ProxyProvider

Return proxy to Provider when complete a download.

Specified by:

returnProxy in interface ProxyProvider

Parameters:

proxy - the proxy config contains host,port and identify info

page - the download result

task - the download task

getProxy

public Proxy getProxy(Task task)

Description copied from interface: ProxyProvider

Get a proxy for task by some strategy.

Specified by:

getProxy in interface ProxyProvider

Parameters:

task - the download task

Returns:

proxy