Skip to main content

Rubra

Rubra is a collection of open-weight, tool-calling LLMs.​

Rubra enhances the top open-weight large language models with tool-calling capability. The ability to call user-defined external tools in a deterministic manner while reasoning and chatting makes Rubra models ideal for agentic use cases.

All models are enhanced from the top open-source LLMs with further post-training and methods that effectively teach instruct-tuned models new skills while mitigating catastrophic forgetting. For easy use, we extend popular inferencing projects, allowing you to run Rubra models easily.

Enhanced Models​

Enhanced ModelContext LengthSizeGGUF Quants
rubra-ai/Meta-Llama-3-8B-Instruct8,0008Brubra-ai/Meta-Llama-3-8B-Instruct-GGUF
rubra-ai/Meta-Llama-3-70B-Instruct8,00070Brubra-ai/Meta-Llama-3-70B-Instruct-GGUF
rubra-ai/gemma-1.1-2b-it8,1922Brubra-ai/gemma-1.1-2b-it-GGUF
rubra-ai/Mistral-7B-Instruct-v0.332,0007Brubra-ai/Mistral-7B-Instruct-v0.3-GGUF
rubra-ai/Mistral-7B-Instruct-v0.232,0007Brubra-ai/Mistral-7B-Instruct-v0.2-GGUF
rubra-ai/Phi-3-mini-128k-instruct128,0003Brubra-ai/Phi-3-mini-128k-instruct-GGUF
rubra-ai/Qwen2-7B-Instruct131,0727Brubra-ai/Qwen2-7B-Instruct-GGUF

Demo​

Try out the models immediately without downloading anything in Huggingface Spaces! It's free and requires no login.

Run Rubra Models Locally​

We extend the following inferencing tools to run Rubra models in an OpenAI-compatible tool-calling format for local use:

Note: Llama3 models, including the 8B and 70B variants, are known to experience increased perplexity and a subsequent degradation in function-calling performance as a result of quantization. We recommend serving them with either vLLM or using the fp16 quantization.

Contributing​

Contributions to Rubra are welcome! We'd love to improve tool-calling capability in the models based on your feedback. Please submit issues to the GitHub repository.

License​

Rubra code is licensed under the Apache 2.0 License. Rubra enhanced models are published under the same license as the parent model.

For more details and documentation, visit the Rubra GitHub page.