WIEWAVE home

Hugging Face TGI on Azure & AWS

Text Generation Inference with tensor parallelism and continuous batching configured for GPU serving at real concurrency. Built and maintained by WIEWAVE for Azure Marketplace and AWS Marketplace, on Ubuntu, Debian, Red Hat Enterprise Linux, AlmaLinux and Rocky Linux.

Hugging Face TGI at a glance

Key facts about Hugging Face TGI
Built & maintained byWIEWAVE
CategoryAI & Machine Learning
Operating systemsUbuntu, Debian, Red Hat Enterprise Linux, AlmaLinux, Rocky Linux
MarketplacesAzure Marketplace and AWS Marketplace
Offer typesPublic listing, with private offers on request

Availability by marketplace

Where Hugging Face TGI is published
MarketplaceStatus
Azure MarketplacePublished
AWS MarketplacePublished
Google Cloud MarketplaceAvailable on request

Need it on another marketplace, or as a private offer for your organisation? cloud@wiewave.com

Operating systems

Hugging Face TGI is built on 5 distributions

Each image follows its distribution's own provisioning model, package manager and security tooling — not one build relabelled several times.

  • Ubuntu

    LTS and interim releases, Minimal and Pro variants, built to Canonical's cloud-image conventions.

  • Debian

    Stable and oldstable, with backports where a workload needs a newer runtime than the release ships.

  • Red Hat Enterprise Linux

    RHEL 8 and 9 images, including BYOS and pay-as-you-go licensing models on each marketplace.

  • AlmaLinux

    The 1:1 RHEL-compatible rebuild, and the default landing spot for teams migrating off CentOS Linux.

  • Rocky Linux

    Enterprise-grade RHEL compatibility with a community governance model, on 8 and 9 streams.

How it's built

How WIEWAVE builds and maintains this image

The same four steps behind every offer we've published, including the hardening and CIS Benchmark checks every build goes through.

  1. 01

    Scoped

    The distribution, licensing model and target marketplaces are agreed before anything is built.

  2. 02

    Built & hardened as code

    Packer templates, Ansible provisioning and a pinned package set — then hardened, scanned and checked against the CIS Benchmark for its distribution.

  3. 03

    Certified & published

    Taken through each cloud's own certification pipeline before it goes live on the marketplace.

  4. 04

    Maintained

    Rebuilt on the upstream security cadence and re-published, with old versions retired without breaking deployments.

FAQ

Hugging Face TGI: common questions

If yours isn't here, ask our marketplace team directly.

AI & Machine Learning

More in AI & Machine Learning

GPU-ready training and inference images with drivers, CUDA and frameworks already matched to each other.

AI & Machine Learning

HumanFirst

Platform for natural language data work, letting teams cluster, label and curate conversational utterances into intents and training sets for NLU models.

Available on distributions:UbuntuDebian
Published onAzure Marketplace
AI & Machine Learning

Hyperopt

Python library for hyperparameter search using random, TPE and adaptive algorithms, installed alongside SciPy and a Jupyter environment for distributed trials.

Available on distributions:UbuntuDebian
Published onAzure Marketplace, AWS Marketplace
AI & Machine Learning

Imagen

Tooling and SDK access for Google's Imagen text-to-image models, covering image generation, editing, upscaling and captioning through Vertex AI endpoints.

Available on distributions:UbuntuDebian
Published onAzure Marketplace, Google Cloud Marketplace
AI & Machine Learning

Infer.NET

Microsoft framework for model-based machine learning that lets .NET developers describe probabilistic graphical models and run Bayesian inference over them.

Available on distributions:UbuntuDebianWindows
Published onAzure Marketplace
AI & Machine Learning

InfoXLM

Cross-lingual pretrained language model from Microsoft trained with information-theoretic objectives, used for multilingual classification and retrieval after fine-tuning.

Available on distributions:UbuntuDebian
Published onAzure Marketplace
AI & Machine Learning

Intel OpenVINO

Toolkit for optimising and running deep learning inference on Intel CPUs and integrated GPUs, including model conversion, quantisation and the runtime.

Available on distributions:UbuntuDebianRHELAlmaLinuxRocky
Published onAzure Marketplace, AWS Marketplace
See all 247 products in AI & Machine Learning

Need Hugging Face TGI customised, or on another cloud?

Tell us the distribution, the marketplace and the commercial model — we'll build, certify and publish it as a public listing or a private offer.