← Open Source
aws-neuron

aws-neuron-sdk

Powering AWS purpose-built machine learning chips. Blazing fast and cost effective, natively integrated into PyTorch and TensorFlow and integrated with your favorite AWS services.

InfrastructureDeploy & ServeModel optimizationPython
Open on GitHub
Momentum
+0stars in 24 hours0.0%
640
Stars
198
Forks
+0
This week
100
Contributors
Created 2019-11-06 · Updated 2026-10-10 · #15673 today
Top developers

aws-neuron/aws-neuron-sdk is ranked 15,673 with 640 stars.

Same-category comparison

aws-neuron/aws-neuron-sdk is ranked 15,673 among these 8 peers; perone/euclidesdb is ranked 15,654.

Same-category comparison
NameRankMetrics
apache/casbin-gateway15,630
Language:
Go
Stars:
642
Forks:
71
Description:
See what every AI coding agent on your machine is doing, and whether the API behind it is the one you paid for. Claude Code, Codex, Cursor, Gemini CLI and more: one endpoint for 44 model vendors, A–F API authenticity grading, per-agent permissions, usage and prompt records.
open-edge-platform/dlstreamer15,633
Language:
C++
Stars:
642
Forks:
211
Description:
Deep Learning Streamer (DL Streamer) Pipeline Framework is an open-source streaming media analytics framework, based on GStreamer* multimedia framework, for creating complex media analytics pipelines for the Cloud or at the Edge.
NVIDIA/runx15,643
Language:
Python
Stars:
641
Forks:
42
Description:
Deep Learning Experiment Management.
perone/euclidesdb15,654
Language:
C++
Stars:
641
Forks:
31
Description:
A multi-model machine learning feature embedding database.
BingZi-233/check-cx15,702
Language:
TypeScript
Stars:
638
Forks:
133
robertvoy/ComfyUI-Distributed15,716
Language:
Python
Stars:
638
Forks:
65
Description:
ComfyUI extension that enables multi-GPU processing locally, remotely and in the cloud.
nicobailon/surf-cli15,730
Language:
TypeScript
Stars:
637
Forks:
60
Description:
The CLI for AI agents to control Chrome. Zero config, agent-agnostic, battle-tested.
Helicone/ai-gateway15,736
Language:
Rust
Stars:
636
Forks:
60
Description:
The fastest, lightest, and easiest-to-integrate AI gateway on the market. Fully open-sourced.
Key parameters and specifications
Key parameters and specifications
ParameterValue
LanguagePython
CategoryInfrastructure
SubcategoryDeploy & Serve, Model optimization
KeywordsInference optimization
Stars640
Forks198
Contributors100
Created date2019-11-06
Updated date2026-10-10
Stars in 1 day0
Stars in 7 days0
Rank15,673
Previous rank15,481
Rank change-192
7-day stars rank15,117
Previous 7-day stars rank15,122
7-day stars rank change5
Total stars rank15,976
Previous total stars rank15,952
Total stars rank change-24
README summary

AWS Neuron Neuron SDK Overview AWS Neuron is a software development kit (SDK) enabling high-performance deep learning and generative AI using AWS Inferentia and Trainium accelerators. With Neuron, you can develop, profile, and deploy machine learning workloads on accelerated EC2 instances (Inf1, Inf2, Trn1, Trn2, Trn3). Neuron includes a graph compiler, runtime, developer tools (Neuron Explorer, agentic development tools), and integrates with PyTorch, JAX, and vLLM Neuron for inference serving. The Neuron Kernel Interface (NKI) provides direct NeuronCore programming

for custom kernels. Neuron SDK's documentation For full documentation including user guides, tutorials, and API references, see Neuron SDK documentation. Support If none of the GitHub and online resources have an answer to your question, visit AWS re:Post for community support.

Frequently asked questions

How many stars and forks are recorded?

aws-neuron/aws-neuron-sdk has 640 stars and 198 forks.

What is the repository rank?

aws-neuron/aws-neuron-sdk is ranked 15,673.

What language and category are recorded?

aws-neuron/aws-neuron-sdk has 640 stars, uses Python and belongs to Infrastructure.

Which repository is closest in rank?

aws-neuron/aws-neuron-sdk is compared with perone/euclidesdb, ranked 15,654 with 641 stars.

README

AWS Neuron

Neuron SDK Overview

AWS Neuron is a software development kit (SDK) enabling high-performance deep learning and generative AI using AWS Inferentia and Trainium accelerators. With Neuron, you can develop, profile, and deploy machine learning workloads on accelerated EC2 instances (Inf1, Inf2, Trn1, Trn2, Trn3).

Neuron includes a graph compiler, runtime, developer tools (Neuron Explorer, agentic development tools), and integrates with PyTorch, JAX, and vLLM Neuron for inference serving. The Neuron Kernel Interface (NKI) provides direct NeuronCore programming for custom kernels.

Neuron SDK's documentation

For full documentation including user guides, tutorials, and API references, see Neuron SDK documentation.

Support

If none of the GitHub and online resources have an answer to your question, visit AWS re:Post for community support.

Nearby in the ranking
Similar items