Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Finer concurrency control than concurrentTasks #420

Open
brainrake opened this issue Apr 19, 2022 · 1 comment
Open

Finer concurrency control than concurrentTasks #420

brainrake opened this issue Apr 19, 2022 · 1 comment
Labels
enhancement New feature or request

Comments

@brainrake
Copy link
Contributor

concurrentTasks is not an adequate control for concurrency because evaluation, download, and build are all tasks. If concurrentTasks is too low, which depends on current load (lots of downloads that don't use cpu, eval waiting for IFD), the server is underutilised. However if it is too high, it runs out of memory easily.
To utilise a server adequately, we need to set limits CPU-intensive, network-intensive, and other (eg. eval waiting for IFD) tasks separately. Limiting concurrent jobs is also useful, to avoid slowdown caused by spreading resources too thin.
Eg.
concurrentJobs = 4
concurrentBuilds = 16
concurrentDownloads = 32
Number of evaluation tasks should be just enough to allow an eval for each job and IFD.

@brainrake brainrake added the enhancement New feature or request label Apr 19, 2022
@L-as
Copy link

L-as commented Apr 19, 2022

FWIW I think downloads and builds are considered the same by Nix

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

2 participants