← Open Source
NimbleEdge

deliteAI

On-device Agentic AI platform.

InfrastructureDeploy & ServeOrchestrationC++
Open on GitHub
Momentum
+0stars in 24 hours0.0%
522
Stars
41
Forks
+0
This week
16
Contributors
Created 2025-05-05 · Updated 2026-10-10 · #17801 today
Top developers
void-memoriesnrjpoddarjpuneet

NimbleEdge/deliteAI is ranked 17,801 with 522 stars.

Same-category comparison

NimbleEdge/deliteAI is ranked 17,801 among these 8 peers; algal/pi-openai-server-compaction is ranked 17,806.

Same-category comparison
NameRankMetrics
microsoft/vattention17,750
Language:
C
Stars:
525
Forks:
46
Description:
Dynamic Memory Management for Serving LLMs without PagedAttention.
modal-labs/modal-client17,751
Language:
Python
Stars:
525
Forks:
138
Description:
SDK libraries for Modal.
brontoguana/krasis17,764
Language:
C++
Stars:
524
Forks:
33
Description:
Krasis is a Hybrid LLM runtime which focuses on efficient running of larger models on consumer grade VRAM limited hardware.
tinykit-studio/tinykit17,770
Language:
Svelte
Stars:
524
Forks:
78
Description:
Self-hosted Lovable/v0 alternative. Realtime database & storage included.
algal/pi-openai-server-compaction17,806
Language:
TypeScript
Stars:
522
Forks:
46
zolotukhin/zinc17,823
Language:
Zig
Stars:
522
Forks:
22
alex-ilgayev/MCPSpy17,870
Language:
C
Stars:
519
Forks:
78
Description:
MCP Monitoring with eBPF.
different-ai/embedbase17,874
Language:
TypeScript
Stars:
519
Forks:
53
Description:
A dead-simple API to build LLM-powered apps.
Key parameters and specifications
Key parameters and specifications
ParameterValue
LanguageC++
CategoryInfrastructure
SubcategoryDeploy & Serve, Orchestration
KeywordsLocalAI
Stars522
Forks41
Contributors16
Created date2025-05-05
Updated date2026-10-10
Stars in 1 day0
Stars in 7 days0
Rank17,801
Previous rank17,587
Rank change-214
7-day stars rank16,302
Previous 7-day stars rank16,311
7-day stars rank change9
Total stars rank18,717
Previous total stars rank18,694
Total stars rank change-23
README summary

DeliteAI On-Device AI platform for creating delightful experiences DeliteAI is a powerful on-device AI platform for building agentic workflows that enables developers to deliver secure, privacy-aware, and high-performance AI native experiences and applications on mobiles, laptops, wearables, and automobiles. Key Features Developer Productivity Unified and simplified APIs for seamless AI agents integration in Android/iOS/MacOS applications Python interface for orchestrating complex AI agentic workflows via tool calling, memory and LLMs on-device Streamlined development process

for both new and existing applications Portability & Small Form Factor Cross-platform compatibility across operating systems Support for various compute platforms and runtimes Abstracted development layer for the fragmented device landscape Optimized for resource-constrained environments with efficient CPU/memory usage Security & Privacy Privacy-first approach with on-device processing Hardware-accelerated model execution Extensibility Easy integration of custom Python operators Flexible runtime support (ONNX or ExecuTorch) Getting Started To get started, you can: Follow the steps in coreruntime to

build and test the core C++ SDK along with its Python bindings Build and try out the Android and iOS SDK and sample app Explore the available agents in the agents directory. Visit the assistant repo to see it all in action. Documentation Explore our documentation at deliteai. Community engagement We welcome any feedback or suggestions - please join our Discord to engage with the community. Contributing We welcome contributions from the community! Whether you're interested in: Adding new Python operators

Enhancing runtime support Improving documentation Reporting bugs or suggesting features Please read our Contributing Guidelines to get started. License This project is licensed under the Apache License 2.

Frequently asked questions

How many stars and forks are recorded?

NimbleEdge/deliteAI has 522 stars and 41 forks.

What is the repository rank?

NimbleEdge/deliteAI is ranked 17,801.

What language and category are recorded?

NimbleEdge/deliteAI has 522 stars, uses C++ and belongs to Infrastructure.

Which repository is closest in rank?

NimbleEdge/deliteAI is compared with algal/pi-openai-server-compaction, ranked 17,806 with 522 stars.

README

DeliteAI

On-Device AI platform for creating delightful experiences

![Try out fully on-device AI Assistant](https://img.shields.io/badge/Explore-AI Assistant-blue?style=for-the-badge)

DeliteAI is a powerful on-device AI platform for building agentic workflows that enables developers to deliver secure, privacy-aware, and high-performance AI native experiences and applications on mobiles, laptops, wearables, and automobiles.

Key Features

Developer Productivity

  • Unified and simplified APIs for seamless AI agents integration in Android/iOS/MacOS applications
  • Python interface for orchestrating complex AI agentic workflows via tool calling, memory and LLMs on-device
  • Streamlined development process for both new and existing applications

Portability & Small Form Factor

  • Cross-platform compatibility across operating systems
  • Support for various compute platforms and runtimes
  • Abstracted development layer for the fragmented device landscape
  • Optimized for resource-constrained environments with efficient CPU/memory usage

Security & Privacy

  • Privacy-first approach with on-device processing
  • Hardware-accelerated model execution

Extensibility

  • Easy integration of custom Python operators
  • Flexible runtime support (ONNX or ExecuTorch)

Getting Started

To get started, you can:

  • Follow the steps in coreruntime to build and test the core C++ SDK along with its Python bindings

  • Build and try out the Android and iOS SDK and sample app

  • Explore the available agents in the agents directory.

Visit the assistant repo to see it all in action.

Documentation

Explore our documentation at deliteai.dev.

Community engagement

We welcome any feedback or suggestions - please join our Discord to engage with the community.

Contributing

We welcome contributions from the community! Whether you're interested in:

  • Adding new Python operators
  • Enhancing runtime support
  • Improving documentation
  • Reporting bugs or suggesting features

Please read our Contributing Guidelines to get started.

License

This project is licensed under the Apache License 2.0 - see the LICENSE file for details.

Nearby in the ranking
Similar items