Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

GaussianMixture in scikit-learn triggers deadlocks #97

Open
fpavogt opened this issue Mar 2, 2023 · 2 comments
Open

GaussianMixture in scikit-learn triggers deadlocks #97

fpavogt opened this issue Mar 2, 2023 · 2 comments
Labels
help !!! Extra attention is needed wontfix This will not be worked on

Comments

@fpavogt
Copy link
Member

fpavogt commented Mar 2, 2023

Describe the bug

The ``GaussianMixture'' routine triggers deadlocks, which is a know feature apparently: scikit-learn/scikit-learn#19272

Can we find an alternative method (possibly from another package) that is not subject to this ?

@fpavogt fpavogt added bug Something isn't working help !!! Extra attention is needed labels Mar 2, 2023
@fpavogt
Copy link
Member Author

fpavogt commented Mar 2, 2023

Some more info about this underlying OpenMP issue from the scikit-learn crowd.

They tried to submit a patch to OpenMP apparently, but it got rejected. Seems that the real issue is with python's "multiprocessing" package.

Interesting quote from the OpenMP patch thread.

The really nasty case is when the code using omp and the code using fork() are in entirely different pieces of code, that don't know about each other (e.g., different shared libraries).

Which I believe is exactly what is happening to us.

@fpavogt fpavogt added wontfix This will not be worked on and removed bug Something isn't working labels Apr 24, 2023
@fpavogt
Copy link
Member Author

fpavogt commented Apr 24, 2023

This turns out to be a feature of Python. As such, I don't plan to fix it anytime soon.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
help !!! Extra attention is needed wontfix This will not be worked on
Projects
None yet
Development

No branches or pull requests

1 participant