Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

历史数据爬取不全 #182

Open
swortex opened this issue Dec 13, 2024 · 0 comments
Open

历史数据爬取不全 #182

swortex opened this issue Dec 13, 2024 · 0 comments

Comments

@swortex
Copy link

swortex commented Dec 13, 2024

大佬好,我是新手,折腾了挺久还是没能解决这个问题,所以想请教一下。我用了区间作业的命令:python .\execute_daily_job.py 2024-12-01 2024-12-9,尝试了多次,还是有很多数据缺少,比如每日股票数据就只有2号、9号的,中间的都没有。股票分红配送、行业资金流向等页面都缺了几天。我看了log文件, 有一些这样的异常:stockfetch.fetch_stock_top_entity_data处理异常:("Connection broken: InvalidChunkLength(got length b'', 0 bytes read)", InvalidChunkLength(got length b'', 0 bytes read)),不知道是不是爬取过程中数据读取失败导致的?有没有什么办法可以解决这个问题?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant