Powering AWS purpose-built machine learning chips. Blazing fast and cost effective, natively integrated into PyTorch and TensorFlow and integrated with your favorite AWS services
See what every AI coding agent on your machine is doing, and whether the API behind it is the one you paid for. Claude Code, Codex, Cursor, Gemini CLI and more: one endpoint for 44 model vendors, A–F API authenticity grading, per-agent permissions, usage and prompt records.
Deep Learning Streamer (DL Streamer) Pipeline Framework is an open-source streaming media analytics framework, based on GStreamer* multimedia framework, for creating complex media analytics pipelines for the Cloud or at the Edge.
The fastest, lightest, and easiest-to-integrate AI gateway on the market. Fully open-sourced.
关键参数与规格
关键参数与规格
参数
值
语言
Python
类别
Infrastructure
子类别
Deploy & Serve,Model optimization
关键词
Inference optimization
星标数
640
分叉数
198
贡献者
100
创建日期
2019-11-06
更新日期
2026-10-10
1 天星标数
0
7 天星标数
0
排名
15,673
上次排名
15,481
排名变化
-192
7 天星标排名
15,117
上次 7 天星标排名
15,122
7 天星标排名变化
5
总星标排名
15,976
上次总星标排名
15,952
总星标排名变化
-24
README 摘录
AWS Neuron Neuron SDK Overview AWS Neuron is a software development kit (SDK) enabling high-performance deep learning and generative AI using AWS Inferentia and Trainium accelerators. With Neuron, you can develop, profile, and deploy machine learning workloads on accelerated EC2 instances (Inf1, Inf2, Trn1, Trn2, Trn3). Neuron includes a graph compiler, runtime, developer tools (Neuron Explorer, agentic development tools), and integrates with PyTorch, JAX, and vLLM Neuron for inference serving. The Neuron Kernel Interface (NKI) provides direct NeuronCore programming
for custom kernels. Neuron SDK's documentation For full documentation including user guides, tutorials, and API references, see Neuron SDK documentation. Support If none of the GitHub and online resources have an answer to your question, visit AWS re:Post for community support.
AWS Neuron is a software development kit (SDK) enabling high-performance deep learning and generative AI using AWS Inferentia and Trainium accelerators. With Neuron, you can develop, profile, and deploy machine learning workloads on accelerated EC2 instances (Inf1, Inf2, Trn1, Trn2, Trn3).
Neuron includes a graph compiler, runtime, developer tools (Neuron Explorer, agentic development tools), and integrates with PyTorch, JAX, and vLLM Neuron for inference serving. The Neuron Kernel Interface (NKI) provides direct NeuronCore programming for custom kernels.
Neuron SDK's documentation
For full documentation including user guides, tutorials, and API references, see Neuron SDK documentation.
Support
If none of the GitHub and online resources have an answer to your question, visit AWS re:Post for community support.
