New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Some matrix field broadcasting results in `Failed to compile PTX code (ptxas received signal 9)` errors #2035

Open

charleskawczynski opened this issue Oct 11, 2024 · 0 comments

Labels

bug GPU

Member

charleskawczynski commented Oct 11, 2024

For example: https://buildkite.com/clima/climacore-ci/builds/4458#01924384-ee2a-4328-a106-c6501a46657e.

Per Tim Besard on slack:

signal 9 comes from outside; OOM killer maybe?

I confirmed with him, this is OOM during compilation.

I'm not sure how we can fix this. I think we'll need to profile some simpler cases to see where the compiler is mostly allocating.

charleskawczynski added bug GPU labels

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment