Is it possilble to use other models (not in Models Registry)

[gilgamsh]

I have read #1230 this issue #1230 .
But I want to know if huggingface does not have the gguf format. How should I do?
(I want to try other models better than TabbyML/DeepseekCoder-6.7B, since DeepseekCoder-6.7B is still not the limit of my device)

[wsxiaoys]

Yes, please refer "How can I convert my own model for use with Tabby?" in https://tabby.tabbyml.com/docs/faq/

But I want to know if huggingface does not have the gguf format. How should I do?

You could either convert it by your self, or see if https://huggingface.co/TheBloke has converted it for you, for example https://huggingface.co/TheBloke/CodeLlama-70B-hf-GGUF/tree/main

[gilgamsh]

Thank you very much.