Skip to content

Issues: TeamHG-Memex/scrapy-rotating-proxies

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

45 Open 9 Closed
45 Open 9 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

Proxies are only differentiated by domain:port
#71 opened Sep 18, 2024 by DJousto
Use Queue to selec the next proxy
#70 opened May 9, 2024 by devfox-se
how to use proxy authentication username and password
#69 opened Dec 11, 2022 by zcafetoday
1
How to Update the proxy_list.
#67 opened Jan 11, 2022 by Kamranbarlas
it keeps checking my proxy servers Dead or not than actually doing its job of scraping data
#66 opened Dec 25, 2021 by vijaykurhade
1
how to ban the proxy with timeout?
#65 opened Nov 11, 2021 by leolle
1
Proxies working for longer time slows scraping down.
#64 opened Nov 10, 2021 by Kamranbarlas
2
Where is the settings.py? Should I create a new one for me?
#63 opened Nov 4, 2021 by alimertkoc
1
Is there a way to bypass the proxy check entirely? Everything Slowed
#61 opened Mar 20, 2021 by doverradio
Please add ability to not assign proxy that is in-use
#60 opened Mar 9, 2021 by iamumairayub
1
AttributeError: Response content isn't text in "response_is_ban"
#58 opened Mar 1, 2021 by iamumairayub
1
RETRY_HTTP_CODES is not taken into account
#56 opened Feb 16, 2021 by caffeinatedMike
scrapy with splash and rotating proxies
#55 opened Feb 16, 2021 by mianwaqas94
1
Update proxy list once a day
#53 opened Nov 3, 2020 by mo-tech55
1
Dependency typing breaks pip install
#52 opened Oct 16, 2020 by StasDeep
3
Shouldn't an IgnoreRequest being raised if max_proxies_to_try is reached
#51 opened Oct 2, 2020 by codekoriko
This middleware breaks default throttling
#50 opened Sep 26, 2020 by 3hhh
Using get_random() to select a proxy is not optimal
#49 opened Sep 25, 2020 by fredd-427
Banned responses get to the engine in the end
#48 opened Sep 19, 2020 by 3hhh
Insensible middleware priority recommendations
#47 opened Sep 19, 2020 by 3hhh
2
Only rotate proxy when banned or dead
#46 opened Sep 6, 2020 by Marow
None of the Proxies are checked - leading to perpetual process where scraping never starts
#45 opened Jul 31, 2020 by caffeinatedMike
stop rotating proxy
#44 opened Jul 9, 2020 by MaziarTalebi
Refresh the list of proxies during scraping
#40 opened Jun 1, 2020 by dibodin
11
Possibility to use proxies from DB?
#39 opened Apr 26, 2020 by fparareda
1
ProTip! Follow long discussions with comments:>50.