Interface ModelSelectOptions

Options for selectModel.

interface ModelSelectOptions {
    budgetIri?: string;
    budgetThreshold?: number;
    capabilityIri: string;
    limit?: number;
}

Properties

budgetIri?: string

Optional IRI of a mesh:TokenBudget resource.

When provided, the query will attempt to join the budget data and use it to determine whether the downgrade path should be applied.

budgetThreshold?: number

Fraction of max tokens below which the cheapest model is preferred. Defaults to DEFAULT_BUDGET_THRESHOLD (0.2).

capabilityIri: string

IRI of the required agent capability. Must be a valid IRI (validated by instantiateTemplate).

`'https://meshpocalypse.dev/ontology#Summarise'`

limit?: number

Maximum number of model candidates to retrieve from the graph. Defaults to DEFAULT_CANDIDATE_LIMIT (10).