DeliteAI is a powerful on-device AI platform for building agentic workflows that enables developers
to deliver secure, privacy-aware, and high-performance AI native experiences and applications
on mobiles, laptops, wearables, and automobiles.

Key Features

Developer Productivity

• Unified and simplified APIs for seamless AI agents integration in Android/iOS/MacOS applications
• Python interface for orchestrating complex AI agentic workflows via tool calling, memory and LLMs on-device
• Streamlined development process for both new and existing applications

Portability & Small Form Factor

• Cross-platform compatibility across operating systems
• Support for various compute platforms and runtimes
• Abstracted development layer for the fragmented device landscape
• Optimized for resource-constrained environments with efficient CPU/memory usage

Security & Privacy

• Privacy-first approach with on-device processing
• Hardware-accelerated model execution

Extensibility

• Easy integration of custom Python operators
• Flexible runtime support (ONNX or ExecuTorch)

Getting Started

To get started, you can:

• Follow the steps in coreruntime to build and test the core C++ SDK along
  with its Python bindings
• Build and try out the Android and iOS SDK and
  sample app

• Explore the available agents in the agents directory.

Visit the assistant repo to see it all in action.

Documentation

Explore our documentation at deliteai.dev.

Community engagement

We welcome any feedback or suggestions - please join our
Discord to engage with the community.

Contributing

We welcome contributions from the community! Whether you're interested in:

• Adding new Python operators
• Enhancing runtime support
• Improving documentation
• Reporting bugs or suggesting features

Please read our Contributing Guidelines to get started.

License

This project is licensed under the Apache License 2.0 - see the LICENSE file for details.