gguf-models

This custom_node for ComfyUI adds one-click "Virtual VRAM" for any UNet and CLIP loader as well MultiGPU integration in WanVideoWrapper, managing the offload/Block Swap of layers to DRAM *or* VRAM to maximize the latent space of your card. Also includes nodes for directly loading entire components (UNet, CLIP, VAE) onto the device you choose

LeanType is an Open-source keyboard, fork of HeliBoard with additional features and customisation

Kimi K3, deepseek v4 flash, glm 5.2, qwen 3.8 27b, Muse Glimmer, Nemotron, glm 5.3, ox alpha, glm 5.3 flash, mimo 3

A quant trading system platform based on FinGPT, demonstrating new applications of large pre-trained Language Models in quantitative finance.

On-device AI chat for iOS. Private, offline-first. Runs open-weight LLMs via llama.rn with semantic memory - no cloud, no API keys

Experimental interface environment for open source LLM, designed to democratize the use of AI. Powered by llama-cpp, llama-cpp-python and Gradio.

Inspect LLM's logprobs and perplexity over a piece of text, or compare two LLMs (like a git diff)

Obrew Server: A self-hostable machine learning engine. Build agents and schedule workflows private to you.

Run Llama 3.3, DeepSeek-R1, Phi-4, Gemma 3, Mistral Small 3.1, and other state-of-the-art language models locally with scorching-fast performance. Inferno provides an intuitive CLI and an OpenAI/Ollama-compatible API, putting the inferno of AI innovation directly in your hands.

Your terminal's AI co-pilot. Describe your intent and get the command.

Run GGUF through llama.cpp and SafeTensors through vLLM behind one OpenAI-compatible endpoint. Your coding tools select a model; the switchboard manages the local runtime, process, and resident-model change.

Create out symbolic links for the GGUF Models in Ollama Blobs. for use in other applications such as Llama.cpp/Jan/LMStudio etc. / 将 Ollama GGUF 模型文件软链接出，以便其他应用使用。

Running GGUF-Format ML Models in Pure Go

An offline AI chat application built specifically for Ubuntu Touch, allowing users to run lightweight Large Language Models (LLMs) directly on their mobile device.

Simple Python Script that converts the Weight of a GGUF Model to a PyTorch Tensor

DoE Janus Architecture: Democracy of Experts

YENT: You. Exist. No. Translation.

RA Local AI – Run GGUF models on your Android phone and chat fully offline.

Web UI for orchestrating distributed llama.cpp RPC GPU clusters with auto node discovery, telemetry, and one-click deployment.

GGUF model list & tools