The PSEAutomation repository contains a curated collection of automation tools, deployment assets, and utilities designed to accelerate Cloudera PSE (Partner Solutions Engineering) use cases.
This repository is structured into distinct modules that provide building blocks for infrastructure provisioning, Kubernetes operators, participant onboarding using AMPs, and Cloudera on-cloud deployments.
This folder contains instructions to perform benchmarking of Cloudera Data Platform (CDP) environments through TPC-DS and Terasuite performance testing. It generates benchmark datasets at a chosen scale, executes engine-specific query suites, and produces result sheets to validate cluster performance and readiness for certification.
Key capabilities:
-
TPC-DS benchmarking tests across Hive, Impala, Spark, and Trino.
-
Terasuite testing (Teragen, Terasort, Teravalidate) for baseline cluster I/O and sort performance.
-
Configurable scale factor for data generation, from small-scale runs to multi-TB workloads.
-
Engine-specific query execution and timing capture for each TPC-DS run.
This folder contains automation for validating Cloudera environments through end-to-end smoke testing. It provisions a temporary validation runner, executes health and service checks, and generates reports to verify cluster readiness and operational status.
Key capabilities:
-
Automated smoke testing of Cloudera environments.
-
Validation of Cloudera Manager connectivity and cluster services.
-
Collection of health, storage, and service status information.
-
Report generation in JSON, HTML, Prometheus, and Nagios-compatible formats.
-
Ephemeral AWS-based validation runners with automated cleanup.
This folder contains Kubernetes Operators and supporting manifests to streamline the deployment and management of Cloudera services on Kubernetes.
Key capabilities:
-
Operator deployment examples for Cloudera components.
-
Automated lifecycle management (install, scale, delete).
-
Configurations to integrate Cloudera services with Kubernetes-native features.
This folder contains automation scripts, templates, and configurations for deploying Cloudera components on AWS cloud environments.
Key capabilities:
-
AWS infrastructure provisioning using Infrastructure-as-Code.
-
Build scripts for reproducible deployments.
This folder contains Selenium based automation tailored for CAI project creation and deploying AMPs for workshop participants.
This folder contains automation modules for provisioning PVC-based infrastructure deployments.
Key capabilities:
-
Automated PVC infrastructure bootstrap.
This folder contains general-purpose scripts, helper tools, and reusable automation modules that support the other components in the repository.
Key capabilities:
-
Common functions and shared code snippets.
-
Helper utilities for monitoring, debugging, and maintenance.
-
Time-saving tools for repetitive tasks.
|
Note
|
Copyright Notice All material is Copyright (c) 2020-2025 Cloudera, Inc. unless stated otherwise. |