ctransformers

[ricardoborges]

any plans to integrate to run using ctransformers?

[dosubot[bot]]

🤖

Hello @ricardoborges!

I'm Dosu, an AI bot here to assist you with any LlamaIndex-related queries, bugs, or contributions while you're waiting for a human maintainer. Don't worry, I'm here to help. Let's make your LlamaIndex experience smoother!

Based on the current information available in the LlamaIndex repository, there are no explicit plans to integrate with ctransformers. The current codebase has a dependency on the transformers library, as indicated in the pyproject.toml file:

transformers = {extras = ["torch"], optional = true, version = "^4.34.0"}

If ctransformers is a different library that conflicts with the transformers library, then there could be a conflict. However, without specific information about ctransformers and its potential conflicts, it's impossible to definitively say whether a conflict would occur.

Unfortunately, I couldn't find any specific information about the ctransformers library in the provided context, so I can't provide details about its functionality or potential compatibility issues with the transformers library currently used in LlamaIndex.

Also, I couldn't find any existing issues or feature requests in the LlamaIndex repository that suggest a need or desire for integration with ctransformers.

If you could provide more details about the ctransformers library and the specific functionality you're interested in integrating with LlamaIndex, I might be able to give a more precise answer.

Sources:

• pyproject.toml
• docs/module_guides/loading/ingestion_pipeline/transformations.md

-Dosu

Sources

• pyproject.toml
• docs/module_guides/loading/ingestion_pipeline/transformations.md

---

This response is meant to be useful and save you time. It is not meant to be a precise solution, but rather a starting point for your own research.

Help me be more useful! Please leave a 👍 if this is helpful and 👎 if it is irrelevant.

If you want to continue the conversation, start your reply with @dosu-bot.