cappr.llama_cpp

Install the Llama CPP requirements to use this module:

pip install "cappr[llama-cpp]"

See this section of the documentation:

https://cappr.readthedocs.io/en/latest/select_a_language_model.html#llama-cpp

• cappr.llama_cpp.classify
  • cache()
  • cache_model()
  • log_probs_conditional()
  • log_probs_conditional_examples()
  • predict()
  • predict_examples()
  • predict_proba()
  • predict_proba_examples()
  • token_logprobs()