Skip to content
View akash20065ray-sys's full-sized avatar
1 follower · 1 following

Block or report akash20065ray-sys

Block user

Prevent this user from interacting with your repositories and sending you notifications. Learn more about blocking users.

You must be logged in to block users.

Content in all repositories owned by your account will be closed.
Maximum 250 characters. Please don’t include any personal information such as legal names or email addresses. Markdown is supported. This note will only be visible to you.
Report abuse

Contact GitHub support about this user’s behavior. Learn more about reporting abuse.

Report abuse
akash20065ray-sys/README.md

💫 Akash Kumar

AI Systems & GPU Infrastructure • Low-Level Systems • Deep Learning Runtimes

B.Tech Computer Engineering • Vishwakarma Institute of Technology (VIT Pune)

Typing SVG

Email GitHub nano-vllm Live Demo 3D Solar System

🌌 Interactive 3D Solar System & Galaxy Architecture

Every major engineering system I've built maps to a celestial body in my 3D Solar System & Galaxy Portfolio (procedural WebGL simulation built with Three.js):

Celestial Body Flagship Engineering System Planetary Specialty & Metric
☀️ The Sun Akash Kumar (Core) Central Thesis: GPU Infrastructure, Bare-Metal & Low-Latency Systems
☿️ Mercury CipherSieve Sub-ms payload-agnostic encrypted TLS 1.3 threat detection (< 1.0 ms)
♀️ Venus Argus-ML High-pressure streaming statistical drift (KS / PSI) & DAG root-cause engine
🌍 Earth & Moon LogicVerse Visual IDE for Discrete Mathematics, DAG topology & Automata simulators
♂️ Mars Crimson Orbit Sub-15ms (11.8 ms) real-mode 8086 WebAssembly AudioWorklet synthesis
♃ Jupiter nano-vllm Titan of Memory: Paged KV-Cache, continuous batching & 0.00% fragmentation
♄ Saturn ORCA Distributed orchestration ring of 8 specialized marine intelligence agents
Metric Measured Value Significance Benchmark Target
⏱️ Audio Latency 11.8 ms Sub-15ms Real-Time Bare-Metal Synthesis Crimson_Orbit
⚡ I/O Bus Interception 0.889 µs Targeted Real-Mode PIT 8253 Bus Trapping Crimson_Orbit
🧠 VRAM Fragmentation 0.00 % Paged KV-Cache Dynamic Block Allocation nano-vllm
🔒 Threat Classification < 1.0 ms Payload-Agnostic Early-Flow TLS 1.3 Detection CipherSieve
🔄 Continuous Batching Token-Level Dynamic Iteration Scheduling & Zero OOM nano-vllm

👨‍💻 About Me & Engineering Thesis

I am a systems and AI infrastructure engineer focused on GPU memory architectures, high-throughput LLM serving runtimes, low-latency computer architecture, and bare-metal systems programming.

  • 🚀 AI Systems & Deep Learning Runtimes: Engineering Paged KV-Cache memory allocators, continuous batching iteration-level schedulers, and Copy-On-Write (CoW) prefix caches for transformer inference engines.
  • ⚡ Low-Level Architecture & Firmware: Bare-metal 16-bit real-mode x86 assembly, custom 512-byte MBR bootloaders, bus-cycle hardware interception (PIT 8253 / PPI 61h), and WebAssembly AudioWorklet bridges.
  • 🛡️ Network Systems & Security Intelligence: Sub-millisecond payload-agnostic behavioral threat classification on encrypted (TLS 1.3 / HTTPS) traffic using 13 transport-layer temporal dynamics.
  • 📐 Formal Computation & Visualization: Interactive topological DAG engines, Turing Machine tape visualizers, pushdown automata (PDA) stack simulators, and automated counter-example finders.
  • 🔬 Engineering Philosophy: Designing hardware-conscious systems software, verifying microsecond telemetry, and building rich developer tools.

🛠️ Technical Arsenal & Technology Stack


🧠 AI Systems & Inference Infrastructure

  • Virtual memory paged KV-cache allocators eliminating GPU VRAM fragmentation.
  • Iteration-level continuous batching for maximum Tensor Core saturation.
  • Copy-On-Write (CoW) shared system prompt caching & TTFT optimization.

⚡ Low-Level Systems & Computer Architecture

  • Autonomous 16-bit real-mode kernel execution within 512-byte MBR limit.
  • Targeted 0.889 µs I/O bus cycle trapping (ports 40h–43h / 61h).
  • Real-time AudioWorklet shared ring-buffer WebAssembly bridges.

🛡️ Network Systems & MLOps Observability

  • Sub-millisecond packet metadata extraction without deep payload inspection.
  • Real-time concept & covariate drift detection on streaming datasets.
  • Reverse DAG dependency root-cause isolation with Max-Heap prioritization.

🌐 Web Simulation, Frontend & Infrastructure

  • Node-based interactive DAG evaluation canvas with dynamic cycle prevention.
  • Turing Machine bidirectional tape animations and PDA stack state visualizers.
  • Containerized microservices orchestration and automated CI/CD pipelines.

🌟 Featured Flagship Systems

⚡ nano-vllm

High-Throughput Paged KV-Cache LLM Inference Engine & GPU Memory Management Runtime

  • 🧠 Paged Memory Allocation: Eliminates internal & external GPU VRAM fragmentation via dynamic block allocation.
  • ⚡ Copy-On-Write (CoW) Prefix Sharing: Zero-redundancy prompt caching dropping TTFT to near-zero.
  • 🔄 Iteration-Level Continuous Batching: Retires completed sequences on each token step to saturate Tensor Cores.
  • 🛡️ Fault-Tolerant Preemption: Dynamic LRU block eviction preventing CUDA Out-of-Memory crashes.
  • 📊 Observability HUD: Real-time 2D physical VRAM memory matrix & latency diagnostics.

[Repository] • [Architecture Spec]

🎵 Crimson Orbit

Low-Latency Bare-Metal 8086 Audio Synthesis & Acoustic Resynthesis Platform

  • ⚡ 11.8 ms end-to-end audio latency (6.3× faster than monolithic emulators).
  • ⏱️ 0.889 µs targeted I/O bus-cycle interceptor (PIT 8253 / PPI 61h).
  • 💾 Custom 512-byte MBR bootloader running autonomous real-mode x86 kernel.
  • 🎹 Multi-timbral acoustic resynthesis engine (Steinway Piano, Martin Guitar, Ludwig Drums).
  • ⚡ Pure real-mode x86 assembly synthesized to high-fidelity audio streams.

[Live Web Studio] • [Download v1.0.0 FLP]

🛡️ CipherSieve

Payload-Agnostic Sub-Millisecond TLS 1.3 Threat Classification Engine

  • 🔒 Zero-DPI Decryption: Classifies attacks in encrypted HTTPS/TLS 1.3 without privacy-violating MITM appliances.
  • ⏱️ Early-Flow Inference: Classifies flows from the first 5–50 packets with sub-millisecond CPU latency.
  • 📊 13 Temporal Features: Analyzes packet inter-arrival bursts, directional byte ratios, and TCP window dynamics.
  • ⚡ High-throughput asynchronous pipeline powered by PyTorch and FastAPI.

[Repository]

👁️ Argus-ML

Production Machine Learning Observability & Statistical Drift Engine

  • 📊 Real-time covariate and concept drift detection on streaming inference datasets.
  • 📈 Kolmogorov-Smirnov (KS) & Population Stability Index (PSI) testing pipelines.
  • 🔍 Root-cause isolation via reverse DAG dependency traversal.
  • 🚨 Priority alert dispatch using Max-Heap prioritization queues.

[Repository]

⚡ LogicVerse

Interactive Discrete Mathematics & Automata Simulation IDE

  • 📐 Topological DAG Canvas: Real-time O(|V|+|E|) dependency evaluation for discrete mathematics.
  • 🔄 Automata Theory Suite: Interactive DFA/NFA state graphs, Pushdown Automata (PDA) stack visualizers, and Turing Machine (TM) bidirectional tape simulators.
  • 📊 Set Theory Engine: Dynamic 2-set & 3-set SVG Venn partitioning & PIE cardinality solver.
  • 🤖 LogicAI: Integrated context-aware pedagogical copilot.

[Repository]

🌊 ORCA

Agentic Marine Intelligence & Distributed Decision-Support Orchestrator

  • 🤖 Agentic Architecture: Intent decomposition planner coordinating 8 specialized domain agents.
  • 📡 Real-Time Ocean Telemetry: Integrates NOAA CoastWatch, Copernicus, and INCOIS streaming APIs.
  • 🗺️ Spatial Decision HUD: Interactive Leaflet map with navigable routing and PFZ risk intelligence.
  • 🏆 Developed for Smart India Hackathon (SIH Problem Statement ID: SIH26176).

[Repository]

📊 GitHub Activity & Telemetry

Akash's GitHub Stats Top Languages
GitHub Streak

Engineered with precision by Akash Kumar • AI Systems & GPU Infrastructure • VIT Pune

Popular repositories Loading

  1. ORCA ORCA Public

    Containerized Workflow & Distributed Cloud Systems Orchestrator

    JavaScript 1

  2. Argus-ML Argus-ML Public

    Production Machine Learning Observability & Statistical Drift Detection Engine (KS & PSI Drift Testing, Pipeline Telemetry)

    Python 1

  3. Crimson_Orbit Crimson_Orbit Public

    Low-Latency Bare-Metal 8086 Audio Synthesis & Acoustic Resynthesis Platform (11.8ms AudioWorklet Bridge, IEEE Paper, Bootable x86 MBR)

    HTML 1

  4. akash20065ray-sys akash20065ray-sys Public

    Config and showcase profile for Akash Kumar (@akash20065ray-sys)

    1

  5. nano-vllm nano-vllm Public

    High-throughput Paged KV-Cache LLM inference engine & GPU memory management runtime in PyTorch

    Python 1

  6. CipherSieve CipherSieve Public

    Payload-agnostic sub-millisecond early-flow encrypted (TLS 1.3 / HTTPS) threat classification engine using transport-layer temporal dynamics

    Python