← 开源
NimbleEdge

deliteAI

On-device Agentic AI platform

InfrastructureDeploy & ServeOrchestrationC++
在 GitHub 打开
增长势头
+024 小时新增 Star0.0%
522
Star
41
Fork
+0
本周
16
贡献者
创建于 2025-05-05 · 更新于 2026-10-10 · 今日第 17801 名
主要开发者
void-memoriesnrjpoddarjpuneet

NimbleEdge/deliteAI 排名第 17,801,有 522 个星标。

同类别比较

NimbleEdge/deliteAI 排名第 17,801,此处有 8 个同类条目;algal/pi-openai-server-compaction 排名第 17,806。

同类别比较
名称排名指标
microsoft/vattention17,750
语言:
C
星标数:
525
分叉数:
46
简介:
Dynamic Memory Management for Serving LLMs without PagedAttention
modal-labs/modal-client17,751
语言:
Python
星标数:
525
分叉数:
138
简介:
SDK libraries for Modal
brontoguana/krasis17,764
语言:
C++
星标数:
524
分叉数:
33
简介:
Krasis is a Hybrid LLM runtime which focuses on efficient running of larger models on consumer grade VRAM limited hardware
tinykit-studio/tinykit17,770
语言:
Svelte
星标数:
524
分叉数:
78
简介:
Self-hosted Lovable/v0 alternative. Realtime database & storage included.
algal/pi-openai-server-compaction17,806
语言:
TypeScript
星标数:
522
分叉数:
46
zolotukhin/zinc17,823
语言:
Zig
星标数:
522
分叉数:
22
alex-ilgayev/MCPSpy17,870
语言:
C
星标数:
519
分叉数:
78
简介:
MCP Monitoring with eBPF
different-ai/embedbase17,874
语言:
TypeScript
星标数:
519
分叉数:
53
简介:
A dead-simple API to build LLM-powered apps
关键参数与规格
关键参数与规格
参数值
语言C++
类别Infrastructure
子类别Deploy & Serve,Orchestration
关键词LocalAI
星标数522
分叉数41
贡献者16
创建日期2025-05-05
更新日期2026-10-10
1 天星标数0
7 天星标数0
排名17,801
上次排名17,587
排名变化-214
7 天星标排名16,302
上次 7 天星标排名16,311
7 天星标排名变化9
总星标排名18,717
上次总星标排名18,694
总星标排名变化-23
README 摘录

DeliteAI On-Device AI platform for creating delightful experiences DeliteAI is a powerful on-device AI platform for building agentic workflows that enables developers to deliver secure, privacy-aware, and high-performance AI native experiences and applications on mobiles, laptops, wearables, and automobiles. Key Features Developer Productivity Unified and simplified APIs for seamless AI agents integration in Android/iOS/MacOS applications Python interface for orchestrating complex AI agentic workflows via tool calling, memory and LLMs on-device Streamlined development process

for both new and existing applications Portability & Small Form Factor Cross-platform compatibility across operating systems Support for various compute platforms and runtimes Abstracted development layer for the fragmented device landscape Optimized for resource-constrained environments with efficient CPU/memory usage Security & Privacy Privacy-first approach with on-device processing Hardware-accelerated model execution Extensibility Easy integration of custom Python operators Flexible runtime support (ONNX or ExecuTorch) Getting Started To get started, you can: Follow the steps in coreruntime to

build and test the core C++ SDK along with its Python bindings Build and try out the Android and iOS SDK and sample app Explore the available agents in the agents directory. Visit the assistant repo to see it all in action. Documentation Explore our documentation at deliteai. Community engagement We welcome any feedback or suggestions - please join our Discord to engage with the community. Contributing We welcome contributions from the community! Whether you're interested in: Adding new Python operators

Enhancing runtime support Improving documentation Reporting bugs or suggesting features Please read our Contributing Guidelines to get started. License This project is licensed under the Apache License 2.

常见问题

记录了多少星标和分叉?

NimbleEdge/deliteAI 有 522 个星标和 41 个分叉。

仓库排名是多少?

NimbleEdge/deliteAI 排名第 17,801。

记录的语言和类别是什么?

NimbleEdge/deliteAI 有 522 个星标,语言为 C++,类别为 Infrastructure。

哪个仓库排名最接近?

NimbleEdge/deliteAI 与 algal/pi-openai-server-compaction 比较,后者排名第 17,806,有 522 个星标。

README

DeliteAI

On-Device AI platform for creating delightful experiences

![Try out fully on-device AI Assistant](https://img.shields.io/badge/Explore-AI Assistant-blue?style=for-the-badge)

DeliteAI is a powerful on-device AI platform for building agentic workflows that enables developers to deliver secure, privacy-aware, and high-performance AI native experiences and applications on mobiles, laptops, wearables, and automobiles.

Key Features

Developer Productivity

  • Unified and simplified APIs for seamless AI agents integration in Android/iOS/MacOS applications
  • Python interface for orchestrating complex AI agentic workflows via tool calling, memory and LLMs on-device
  • Streamlined development process for both new and existing applications

Portability & Small Form Factor

  • Cross-platform compatibility across operating systems
  • Support for various compute platforms and runtimes
  • Abstracted development layer for the fragmented device landscape
  • Optimized for resource-constrained environments with efficient CPU/memory usage

Security & Privacy

  • Privacy-first approach with on-device processing
  • Hardware-accelerated model execution

Extensibility

  • Easy integration of custom Python operators
  • Flexible runtime support (ONNX or ExecuTorch)

Getting Started

To get started, you can:

  • Follow the steps in coreruntime to build and test the core C++ SDK along with its Python bindings

  • Build and try out the Android and iOS SDK and sample app

  • Explore the available agents in the agents directory.

Visit the assistant repo to see it all in action.

Documentation

Explore our documentation at deliteai.dev.

Community engagement

We welcome any feedback or suggestions - please join our Discord to engage with the community.

Contributing

We welcome contributions from the community! Whether you're interested in:

  • Adding new Python operators
  • Enhancing runtime support
  • Improving documentation
  • Reporting bugs or suggesting features

Please read our Contributing Guidelines to get started.

License

This project is licensed under the Apache License 2.0 - see the LICENSE file for details.

排名相邻
同类项目