@pezzo/llm-toolkit
LLM Toolkit is a collection of llm providers and utilities.
Installation
npm install @pezzo/llm-toolkitUsage
import { OpenAIToolkit } from "@pezzo/llm-toolkit";Get model pricing
const { promptCostPer1000Tokens, completionCostPer1000Tokens } =
OpenAIToolkit.gptModels["gpt-3.5-turbo"];Calculate cost of a prompt
// the modelName parameter is fully typed, you'll be able to see a a list with the available models
const cost = OpenAIToolkit.calculateGptCost(
promptTokens,
completionTokens,
modelName
);Note: The model name is fully typed, you'll be able to see a list with the available models.
