-
Notifications
You must be signed in to change notification settings - Fork 233
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
fix: add limit to get cells #4576
Conversation
8a31766
to
ed2b597
Compare
010db6c
to
033c182
Compare
# it may cause the physical machine to become unresponsive. | ||
# We recommend a consumption limit of 2g, which is 400 as the limit, | ||
# which is a safer approach | ||
# request_limit = 400 |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
indexer_request_limit
maybe a better name, as it's limiting the indexer request.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
This configuration item is under the indexer module. I don’t think it’s necessary to emphasize that it is the indexer request
5ce8c65
to
bb3c0c9
Compare
@driftluo Please rebase develop |
bb3c0c9
to
4eb59c5
Compare
4eb59c5
to
fb6309d
Compare
fb6309d
to
33e8ae8
Compare
3c827e9
What problem does this PR solve?
close #4520 related serde-rs/json#635
A large number of data requests will consume more than 10x the memory when serialized in JSON, resulting in huge memory overhead and affecting the operation of the server
We recommend setting the memory usage limit at 2 GB, meaning only 200 MB of data can be requested at a time. The maximum cell data size is 500 KB, and 400 cells can be requested at one time.
In addition, we strongly recommend using this configuration #4529 to limit the upper limit of batch requests.
Check List
Tests
Release note