Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Bug]: download of onnx all-MiniLM-L6-v2 fails in chromadb\utils\embedding_functions\onnx_mini_lm_l6_v2.py #2910

Open
bmerkle opened this issue Oct 8, 2024 · 0 comments
Labels
bug Something isn't working

Comments

@bmerkle
Copy link

bmerkle commented Oct 8, 2024

What happened?

I do a fresh setup of chroma, want to compute embeddings with all-MiniLM-L6-v2

the following code results in a timeout exception:
from chromadb.utils import embedding_functions default_ef = embedding_functions.DefaultEmbeddingFunction() val = default_ef(["foo"])

call which fails is:
with httpx.stream("GET", url) as resp:

with httpx.stream("GET", url) as resp:

my fix is to pass the timeout parameter to the httpx.stream() function call, to avoid the timeout, so
with httpx.stream("GET", url, timeout=None) as resp:
fixed the problem.

I will submit this as PR.

Please consider that in corporate networks there maybe proxies, firewalls, which cause a delay, which then results in a failed download of the model. I do not know about a default timeout of httpx but the fix/PR avoids the problem.

I had to roll back to Chroma 0.5.3 because of #2534 and vanna-ai/vanna#584

Versions

Chroma 0.5.3, Python 3.11.9, Windows 10

I had to roll back to Chroma 0.5.3 because of #2534 and vanna-ai/vanna#584

Relevant log output

No response

@bmerkle bmerkle added the bug Something isn't working label Oct 8, 2024
bmerkle added a commit to bmerkle/chroma that referenced this issue Oct 8, 2024
fix for chroma-core#2910

specify timeout, as start of download might take some time because of corporate proxies, firewalls, content scanning etc.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

1 participant