WIEWAVE home

KoboldCpp on Azure & AWS

Single-binary inference server for GGUF language models built on llama.cpp, exposing a chat web UI and an OpenAI-compatible API. Built and maintained by WIEWAVE for Azure Marketplace and AWS Marketplace, on Ubuntu and Debian.

KoboldCpp at a glance

Key facts about KoboldCpp
Built & maintained byWIEWAVE
CategoryAI & Machine Learning
Operating systemsUbuntu, Debian
MarketplacesAzure Marketplace and AWS Marketplace
Offer typesPublic listing, with private offers on request

Availability by marketplace

Where KoboldCpp is published
MarketplaceStatus
Azure MarketplacePublished
AWS MarketplacePublished
Google Cloud MarketplaceAvailable on request

Need it on another marketplace, or as a private offer for your organisation? cloud@wiewave.com

Operating systems

KoboldCpp is built on 2 distributions

Each image follows its distribution's own provisioning model, package manager and security tooling — not one build relabelled several times.

  • Ubuntu

    LTS and interim releases, Minimal and Pro variants, built to Canonical's cloud-image conventions.

  • Debian

    Stable and oldstable, with backports where a workload needs a newer runtime than the release ships.

How it's built

How WIEWAVE builds and maintains this image

The same four steps behind every offer we've published, including the hardening and CIS Benchmark checks every build goes through.

  1. 01

    Scoped

    The distribution, licensing model and target marketplaces are agreed before anything is built.

  2. 02

    Built & hardened as code

    Packer templates, Ansible provisioning and a pinned package set — then hardened, scanned and checked against the CIS Benchmark for its distribution.

  3. 03

    Certified & published

    Taken through each cloud's own certification pipeline before it goes live on the marketplace.

  4. 04

    Maintained

    Rebuilt on the upstream security cadence and re-published, with old versions retired without breaking deployments.

FAQ

KoboldCpp: common questions

If yours isn't here, ask our marketplace team directly.

AI & Machine Learning

More in AI & Machine Learning

GPU-ready training and inference images with drivers, CUDA and frameworks already matched to each other.

AI & Machine Learning

Kornia

Differentiable computer vision library for PyTorch, supplying image transforms, geometry, filtering and feature operators as GPU-ready tensor operations.

Available on distributions:UbuntuDebian
Published onAzure Marketplace
AI & Machine Learning

KServe

Kubernetes custom resources for serving machine learning models, handling autoscaling, canary rollouts and standardised inference endpoints across frameworks.

Available on distributions:UbuntuDebian
Published onAzure Marketplace, AWS Marketplace
AI & Machine Learning

LangChain & Flowise

Preinstalled LangChain libraries alongside Flowise, a drag-and-drop builder for wiring LLM chains, agents and retrieval flows through a browser canvas.

Available on distributions:UbuntuDebian
Published onAzure Marketplace, AWS Marketplace
AI & Machine Learning

LangChain & Langflow

Combines the LangChain framework with Langflow's visual editor so you can prototype retrieval-augmented generation pipelines and export them as runnable Python code.

Available on distributions:UbuntuDebian
Published onAzure Marketplace, AWS Marketplace
AI & Machine Learning

Langflow

Visual low-code environment for composing LLM applications, running the Langflow server with its Python backend, component library and web canvas.

Available on distributions:UbuntuDebian
Published onAzure Marketplace, AWS Marketplace
AI & Machine Learning

Latent Diffusion Model

CompVis latent diffusion research code for text-to-image and image synthesis, with PyTorch, checkpoint loading scripts and GPU inference dependencies installed.

Available on distributions:UbuntuDebian
Published onAzure Marketplace, AWS Marketplace
See all 247 products in AI & Machine Learning

Need KoboldCpp customised, or on another cloud?

Tell us the distribution, the marketplace and the commercial model — we'll build, certify and publish it as a public listing or a private offer.