CAPPr

Completion

After

Prompt

Probability

CAPPr performs text classification. No training. No post-processing.

Just have your LLM pick from a list of choices.

Or compute the probability of a completion given a prompt.

Squeeze more out of open source LLMs.

Get started

• About
  • Is this for me?
  • Motivation
  • Other LLM structuring tools
  • Installation

Get going

• User Guide
  • Select a language model
  • Select a prompt-completion format
  • (Optional) Supply a prior
  • Examples
  • Why predict probabilities?
  • A note on workflow

Details

• Research
  • Related work
  • Computational performance
  • Statistical performance

Package

• API Reference
  • Example
  • cappr.huggingface
  • cappr.llama_cpp
  • cappr.openai
  • cappr.utils

Development

• Local development
  • Local setup
  • Design

Indices and tables

• Index

• Module Index

• Search Page