The Scrapy sample project illustrates the use of the scrapyproxyport middleware

About Proxy Port

Prerequisites

To run this project you will need a free API key. Get your API key here. Detailed instructions here.

Installation

$ git clone https://github.com/proxyport/scrapy-proxyport-example
$ cd scrapy-proxyport-example
$ python -m venv env
$ source env/bin/activate
$ pip install -r requirements.pip

Set API Key

Open scrapy-proxyport-example/blog/blog/settings.py and set your API Key to PROXY_PORT_API_KEY variable.

PROXY_PORT_API_KEY = '<API_KEY>'

Run spider

$ source env/bin/activate
$ cd blog
$ scrapy crawl blogspider