🕸️
Tool Integration
Proxies for Scrapy
Use GProxy proxies with the popular Python framework Scrapy to build powerful and reliable scrapers.
Преимущества для Scrapy
Enhance Scrapy with reliable proxies
🔧
Easy Integration
Ready-made middleware for Scrapy.
🔄
Automatic Rotation
IPs change automatically.
⚡
High Speed
Fast connections for scraping.
🛡️
Bypass Blocks
Residential IPs bypass protections.
Как это работает
Integration in 5 minutes
1
Install Package
pip install scrapy-gproxy
2
Configure settings.py
Add middleware and credentials
3
Run Spider
Proxies connect automatically
4
Scale
Increase CONCURRENT_REQUESTS
Пример интеграции
Scrapy settings.py configuration
# settings.py
DOWNLOADER_MIDDLEWARES = {
'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware': 110,
}
# GProxy credentials
PROXY_USER = 'your_username'
PROXY_PASS = 'your_password'
PROXY_HOST = 'proxy.gproxy.net'
PROXY_PORT = '8080'
def get_proxy_url():
return f'http://{PROXY_USER}:{PROXY_PASS}@{PROXY_HOST}:{PROXY_PORT}'
HTTP_PROXY = get_proxy_url()
HTTPS_PROXY = get_proxy_url()Начните использовать прокси для Scrapy
Выберите подходящий тариф и получите доступ к миллионам IP-адресов