Installation

To use Hugging Face models (including AutoGPTQ and AutoAWQ):

pip install "cappr[hf]"

To use GGUF models:

pip install "cappr[llama-cpp]"

To use OpenAI /v1/completions models (excluding gpt-3.5-turbo-instruct), sign up for the OpenAI API and then:

pip install "cappr[openai]"

(Optional) To use any of the above models:

pip install "cappr[all]"