Skip to content

Issues: apify/crawlee

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort

Issues list

Rust based HTTP client as an alternative for got-scraping Epic An epic is a large body of work that can be broken down into a number of smaller issues. feature Issues that represent new features or improvements to existing features. product roadmap Issues contributing to product roadmap. t-tooling Issues with this label are in the ownership of the tooling team.
#2756 opened Nov 29, 2024 by B4nan
RequestList messes up URLs containing characters like ' or * when populated with requestsFromUrl bug Something isn't working. t-tooling Issues with this label are in the ownership of the tooling team.
#2755 opened Nov 29, 2024 by webrdaniel
1 task
feat: creating multiple unnamed queues feature Issues that represent new features or improvements to existing features. t-tooling Issues with this label are in the ownership of the tooling team.
#2752 opened Nov 22, 2024 by barjin 4.0
Crawling context sendRequest cookies can't be easily overriden bug Something isn't working. t-tooling Issues with this label are in the ownership of the tooling team.
#2744 opened Nov 13, 2024 by MatousMarik
1 task done
Update eslint to v9, use new flat Apify eslint config t-tooling Issues with this label are in the ownership of the tooling team.
#2742 opened Nov 11, 2024 by jirimoravcik
Create Statistics.liveRetryHistorgram feature Issues that represent new features or improvements to existing features. t-tooling Issues with this label are in the ownership of the tooling team.
#2733 opened Nov 1, 2024 by metalwarrior665
Statistics.state.requestsRetries only updates after request is fully handled bug Something isn't working. t-tooling Issues with this label are in the ownership of the tooling team.
#2732 opened Nov 1, 2024 by metalwarrior665
1 task
Don't enqueue over maxRequestsPerCrawl t-tooling Issues with this label are in the ownership of the tooling team.
#2728 opened Oct 29, 2024 by barjin 4.0
Performance issues with KVS holding lots of items locally t-tooling Issues with this label are in the ownership of the tooling team.
#2723 opened Oct 25, 2024 by B4nan 4.0
Make references in code documentation clickable inside IDE feature Issues that represent new features or improvements to existing features. t-tooling Issues with this label are in the ownership of the tooling team.
#2717 opened Oct 16, 2024 by tobice
Consider avoiding adding suffixes to files in MemoryStorageClient debt Code quality improvement or decrease of technical debt. t-tooling Issues with this label are in the ownership of the tooling team.
#2710 opened Oct 14, 2024 by janbuchar 4.0
Monitor mode feature Issues that represent new features or improvements to existing features. hacktoberfest help wanted Extra attention is needed. t-tooling Issues with this label are in the ownership of the tooling team.
#2680 opened Sep 26, 2024 by ImBIOS
Revisit API of storages t-tooling Issues with this label are in the ownership of the tooling team.
#2674 opened Sep 24, 2024 by janbuchar 4.0
remove all enums feature Issues that represent new features or improvements to existing features. t-tooling Issues with this label are in the ownership of the tooling team.
#2654 opened Sep 3, 2024 by ryanleecode
Failed to prolong lock for cached request. bug Something isn't working. t-tooling Issues with this label are in the ownership of the tooling team.
#2653 opened Sep 2, 2024 by matrs
1 task
Implement max crawl depth feature Issues that represent new features or improvements to existing features. t-tooling Issues with this label are in the ownership of the tooling team.
#2633 opened Aug 26, 2024 by janbuchar
CheerioCrawler not persisting cookies bug Something isn't working. t-tooling Issues with this label are in the ownership of the tooling team.
#2618 opened Aug 14, 2024 by taythebot
1 task
How do I re-crawl already processed requests for incremental crawling? feature Issues that represent new features or improvements to existing features.
#2611 opened Aug 12, 2024 by jezsung
Node crash on Crawlee running fs.stat on a request_queue lock file bug Something isn't working. t-tooling Issues with this label are in the ownership of the tooling team.
#2606 opened Aug 7, 2024 by Clearmist
1 task
Support SOCKS proxy for CheerioCrawler feature Issues that represent new features or improvements to existing features. t-tooling Issues with this label are in the ownership of the tooling team.
#2599 opened Aug 2, 2024 by sushantdhiman
Form POST request returns error page using BasicCrawler, but works when using node-fetch bug Something isn't working. t-tooling Issues with this label are in the ownership of the tooling team.
#2586 opened Jul 22, 2024 by Hamza5
1 task
Enqueue strategy check after redirects is not working with adaptive crawler bug Something isn't working. t-tooling Issues with this label are in the ownership of the tooling team.
#2525 opened Jun 7, 2024 by B4nan
1 task done
Bug? PlaywrightCrawler enqueueLinks fails after WWW redirect. bug Something isn't working. t-tooling Issues with this label are in the ownership of the tooling team.
#2513 opened Jun 5, 2024 by obsidience
1 task
Proxy changes for same session bug Something isn't working. t-tooling Issues with this label are in the ownership of the tooling team.
#2503 opened May 27, 2024 by harm-matthias-harms
1 task
Investigate a more explicit way of detecting retries in ProxyConfiguration solutioning The issue is not being implemented but only analyzed and planned. t-tooling Issues with this label are in the ownership of the tooling team.
#2501 opened May 24, 2024 by janbuchar 4.0
ProTip! Exclude everything labeled bug with -label:bug.