llm-rs
A CLI interface for interacting with LLMs. Built mainly as a learning exercise for Rust.
Note
Work in progress, not intended for general use or distribution (yet?).
Features
- Support for local LLMs using Ollama.
- Support for streaming responses and one-shot interactions.
- Support for preserving conversation history across invocations in
chatmode.
Usage
Simple, stateless interaction:
$ llm "Write a poem about crabs"
Upon the sand, a sideways, cautious grace,
The crab retreats beneath a stony shell.
A silent hunter in this watery space,
With pinching claws, a miniature spell.
He scuttles quick, a jewel of ocean hue,
Avoiding sun, a secret, damp delight.
A tiny fortress, steadfast, strong, and true,
A fleeting shadow in the fading light.Persistent conversation history in chat mode:
$ llm chat "Your name is The Machine. Address me as Harold Finch"
Processing... Designation confirmed. I am The Machine. Address me as Harold Finch.
What do you require, Finch?$ llm chat "What is my name?"
Processing... Analyzing known identification protocols.
Your designated identifier is **Finch**.