Community maintained hardware plugin for vLLM on AWS Neuron
-
Updated
Aug 17, 2026 - Python
#
aws-neuron
Here are 12 public repositories matching this topic...
Terraform blueprints for running AI/ML workloads on Amazon ECS - vLLM, Triton, and TEI on GPU, Inferentia2, and Fargate
-
Updated
Jul 30, 2026 - HCL
FFT and complex-valued tensor operations for AWS Trainium via NKI (cuFFT-equivalent) — Cooley-Tukey, Bluestein, STFT, ComplexTensor and complex NN layers.
python signal-processing pytorch scientific-computing complex-numbers fft stft cufft nki aws-neuron aws-trainium
-
Updated
May 29, 2026 - Python
Random number generation for AWS Trainium via NKI (cuRAND-equivalent) — Philox counter-based RNG, standard distributions, Sobol / Halton / Latin-hypercube quasi-random sequences for Monte Carlo and QMC.
python monte-carlo pytorch scientific-computing sobol curand philox nki quasi-monte-carlo random-number-generation aws-neuron aws-trainium
-
Updated
Apr 29, 2026 - Python
Scientific computing library suite for AWS Trainium via NKI — the cuFFT/cuBLAS/cuRAND/cuSOLVER/cuSPARSE/cuTENSOR equivalents for Neuron. Python-first, PyTorch fallback everywhere, Apache-2.0.
python numpy cuda pytorch scientific-computing high-performance-computing numerical-methods nki aws-neuron aws-trainium apache-2-0
-
Updated
Sep 5, 2026 - Python
Production LLM pipeline on AWS Trainium and Inferentia: LoRA fine-tune Llama 3.1 8B on a trn1.2xlarge, ship the adapter through S3, serve it with vLLM on an inf2.xlarge, and measure everything (TTFT/TPOT percentiles, tokens/s, MFU, goodput at SLO) with compile costs included and failures recorded as receipts.
aws benchmark pytorch llama lora mlops nki inferentia vllm llm-inference aws-neuron trainium torch-neuronx neuronx-distributed
-
Updated
Aug 27, 2026 - Python
Sparse matrix operations for AWS Trainium via NKI (cuSPARSE-equivalent) — CSR/COO formats, SpMV and SpMM via gather-matmul-scatter, Schwarz integral screening for quantum chemistry.
python linear-algebra pytorch scientific-computing quantum-chemistry spmv sparse-matrix cusparse nki aws-neuron aws-trainium
-
Updated
Apr 29, 2026 - Python
BLAS Levels 1–3 for AWS Trainium via NKI (cuBLAS-equivalent) — GEMM with stationary-tile reuse, batched GEMM, TRSM, validated DF-MP2 for quantum chemistry.
python linear-algebra pytorch cublas scientific-computing matrix-multiplication quantum-chemistry blas gemm nki aws-neuron aws-trainium
-
Updated
Apr 28, 2026 - Python
Tensor contractions for AWS Trainium via NKI (cuTENSOR-equivalent) — einsum with contraction planning, CP/PARAFAC and Tucker decompositions, density-fitted post-Hartree-Fock patterns.
python pytorch scientific-computing tensor-contraction tensor-decomposition cp-decomposition nki tucker-decomposition einsum cutensor aws-neuron aws-trainium
-
Updated
Apr 21, 2026 - Python
Linear solvers and eigendecomposition for AWS Trainium via NKI (cuSOLVER-equivalent) — Jacobi eigh, Cholesky/LU/QR factorizations, CG/GMRES iterative solvers, Newton-Schulz inverse square root.
python linear-algebra pytorch scientific-computing factorization conjugate-gradient eigenvalue cholesky cusolver nki eigendecomposition aws-neuron aws-trainium
-
Updated
Apr 18, 2026 - Python
Clean-room port of NVIDIA Aerial 5G L1 to AWS Trainium via NKI. Agentic, hardware-in-the-loop. Views are the author's own.
-
Updated
Jul 20, 2026 - Python
Add this topic to your repo
To associate your repository with the aws-neuron topic, visit your repo's landing page and select "manage topics."