Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Unable to scrape a website #3

Open
MGlolenstine opened this issue Apr 2, 2020 · 3 comments
Open

Unable to scrape a website #3

MGlolenstine opened this issue Apr 2, 2020 · 3 comments

Comments

@MGlolenstine
Copy link
Contributor

I'm unable to scrape one particular website, other sites work fine.

This website gets solved incorrectly.

They could be using a custom or at least slightly modified version of CF protection.
Scraping other websites (https://kissanime.ru) works well, so I think that the problem is isolated to that one website.

HTML of protected site

here

@TBye101
Copy link

TBye101 commented May 18, 2021

I'd like to add to this that rent.com is not solved correctly either. Appears to be an issue in the parse_js function, the .captures(html) function is returning None for whatever reason...

@AurevoirXavier
Copy link
Member

I'd like to add to this that rent.com is not solved correctly either. Appears to be an issue in the parse_js function, the .captures(html) function is returning None for whatever reason...

Okay, I'll take a look this weekend.

@TBye101
Copy link

TBye101 commented May 18, 2021

Appreciate it, thanks!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants