WIEWAVE home

PySpark on Azure, AWS & Google Cloud

The Python API for Apache Spark, preinstalled with a local Spark runtime for writing DataFrame and SQL jobs against distributed datasets. Built and maintained by WIEWAVE for Azure Marketplace, AWS Marketplace and Google Cloud Marketplace, on Ubuntu, Debian, Red Hat Enterprise Linux, AlmaLinux and Rocky Linux.

PySpark at a glance

Key facts about PySpark
Built & maintained byWIEWAVE
CategoryAnalytics & Big Data
Operating systemsUbuntu, Debian, Red Hat Enterprise Linux, AlmaLinux, Rocky Linux
MarketplacesAzure Marketplace, AWS Marketplace and Google Cloud Marketplace
Offer typesPublic listing, with private offers on request

Availability by marketplace

Where PySpark is published
MarketplaceStatus
Azure MarketplacePublished
AWS MarketplacePublished
Google Cloud MarketplacePublished

Need it on another marketplace, or as a private offer for your organisation? cloud@wiewave.com

Operating systems

PySpark is built on 5 distributions

Each image follows its distribution's own provisioning model, package manager and security tooling — not one build relabelled several times.

  • Ubuntu

    LTS and interim releases, Minimal and Pro variants, built to Canonical's cloud-image conventions.

  • Debian

    Stable and oldstable, with backports where a workload needs a newer runtime than the release ships.

  • Red Hat Enterprise Linux

    RHEL 8 and 9 images, including BYOS and pay-as-you-go licensing models on each marketplace.

  • AlmaLinux

    The 1:1 RHEL-compatible rebuild, and the default landing spot for teams migrating off CentOS Linux.

  • Rocky Linux

    Enterprise-grade RHEL compatibility with a community governance model, on 8 and 9 streams.

How it's built

How WIEWAVE builds and maintains this image

The same four steps behind every offer we've published, including the hardening and CIS Benchmark checks every build goes through.

  1. 01

    Scoped

    The distribution, licensing model and target marketplaces are agreed before anything is built.

  2. 02

    Built & hardened as code

    Packer templates, Ansible provisioning and a pinned package set — then hardened, scanned and checked against the CIS Benchmark for its distribution.

  3. 03

    Certified & published

    Taken through each cloud's own certification pipeline before it goes live on the marketplace.

  4. 04

    Maintained

    Rebuilt on the upstream security cadence and re-published, with old versions retired without breaking deployments.

FAQ

PySpark: common questions

If yours isn't here, ask our marketplace team directly.

Analytics & Big Data

More in Analytics & Big Data

Batch and streaming engines, orchestration, query federation and the BI layer that sits in front of them.

Analytics & Big Data

Rearc Prophecy.io Implementation

Partner-packaged deployment of Prophecy, a low-code data engineering interface that generates Spark pipelines from a visual editor for ETL workloads.

Available on distributions:UbuntuDebian
Published onAzure Marketplace, AWS Marketplace
Analytics & Big Data

Redash

Query and dashboard tool that connects to SQL and NoSQL sources, letting analysts share visualisations and scheduled reports from a browser.

Available on distributions:UbuntuDebian
Published onAzure Marketplace, AWS Marketplace
Analytics & Big Data

SASPy

Python module that connects notebooks and scripts to a SAS session, letting SAS procedures and datasets be driven directly from Python code.

Available on distributions:UbuntuDebian
Published onAzure Marketplace
Analytics & Big Data

SEO Panel

Open-source control panel that tracks keyword rankings, backlinks, sitemaps and site audits across multiple websites, running on PHP with MySQL.

Available on distributions:UbuntuDebian
Published onAzure Marketplace, AWS Marketplace
Analytics & Big Data

StarRocks

MPP analytical database delivering sub-second queries over real-time and batch data, speaking the MySQL protocol and querying lakehouse table formats directly.

Available on distributions:UbuntuDebianRHELAlmaLinuxRocky
Published onAzure Marketplace, AWS Marketplace, Google Cloud Marketplace
Analytics & Big Data

Talend Open Studio

Graphical ETL and data integration studio built on Eclipse, used to design jobs that extract, transform and load data across files, databases and APIs.

Available on distributions:UbuntuDebianRHELAlmaLinuxRocky
Published onAzure Marketplace, AWS Marketplace
See all 51 products in Analytics & Big Data

Need PySpark customised, or on another cloud?

Tell us the distribution, the marketplace and the commercial model — we'll build, certify and publish it as a public listing or a private offer.