Support for llama.cpp? #419
tuaris
started this conversation in
Feature Requests
Replies: 1 comment
-
|
Heya - I started looking into this and was able to get llama.cpp working with openai compatible provider. Have a draft PR up rn #424 , will get it shipped today after I write the documentation / do more testing. |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
The self-hosted and bring your own model idea is neat. It would be even better if we could use self-hosted models like llama.cpp.
Beta Was this translation helpful? Give feedback.
All reactions