Installation ============ To use Hugging Face models (including `AutoGPTQ `_ and `AutoAWQ `_):: pip install "cappr[hf]" To use GGUF models:: pip install "cappr[llama-cpp]" To use OpenAI `/v1/completions `_ models (`excluding `_ ``gpt-3.5-turbo-instruct``), `sign up `_ for the OpenAI API and then:: pip install "cappr[openai]" (Optional) To use any of the above models:: pip install "cappr[all]"