Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

GGUF support? #115

Open
sij-ai opened this issue Nov 1, 2023 · 3 comments
Open

GGUF support? #115

sij-ai opened this issue Nov 1, 2023 · 3 comments

Comments

@sij-ai
Copy link

sij-ai commented Nov 1, 2023

This doesn't currently support GGUF models, correct? Adding GGUF support would be a huge upgrade. Without it, I have no use for it, with it, I'd probably switch to doing all my inferencing with this app because I like the feature set and UI better than the rest...
@meltingscales
Copy link

+1 on this. @louisgv what needs to be changed/added to support gguf format? Just curious on how much work something like that would be. Awesome app!

@DjagbleyEmmanuel
Copy link

Yup, would be such a wonderful idea to add gguf support.

@thijsi123
Copy link

Bump 🥺

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
4 participants
@meltingscales @DjagbleyEmmanuel @thijsi123 @sij-ai