Skip to content

README.en-US.md

Latest commit

 

History

History
92 lines (66 loc) · 4.34 KB

README.en-US.md

File metadata and controls

92 lines (66 loc) · 4.34 KB
Raw

简体中文 | English | 日本語

XnetDataops

Open-source DataOps for integration, development, governance, and data services

Version Java Spring Boot License

Live Demo · Frontend: XnetDataops-web · OpenXnet · License

XnetDataops overview

Product Tour

Demo login Data source configuration
Demo login Data sources
Data integration SQL workbench
Integration SQL workbench
Workflow scheduling Data quality
Workflows Data quality
Data lineage Data APIs
Lineage Data APIs
Data masking Observability
Masking Observability
Audit About
Audit About

Overview

XnetDataops is an open-source, end-to-end DataOps platform maintained by the SynapXnet team. It manages the data lifecycle from source onboarding and transformation to scheduling, quality, governance, APIs, observability, and audit.

This backend repository and XnetDataops-web form an enterprise-grade, multi-tenant, frontend/backend-separated system. Twelve modular services can be deployed together or integrated by domain.

Highlights

  • Enterprise multi-tenancy with user, role, team, and data boundaries.
  • Complete flow across integration, development, scheduling, quality, governance, and delivery.
  • Independent frontend and backend deployment.
  • Extensible connectors, quality rules, scheduling nodes, APIs, and policies.
  • Continuous improvements from the SynapXnet team.

Modules

Module Service Responsibility
DSM dataops-dsm-service Data source connections and health
DIM dataops-dim-service Batch/incremental synchronization, mappings, and logs
DDV dataops-ddv-service SQL workbench, scripts, saved queries, and history
TSK dataops-tsk-service DAG workflows, dependencies, instances, and execution state
DQM dataops-dqm-service Quality rules, reports, and alerts
DGV dataops-dgv-service Metadata catalog, columns, lineage, and tags
DAS dataops-das-service Data assets, classification, statistics, and access records
DAP dataops-dap-service Data APIs, keys, rate limits, and call logs
DMS dataops-dms-service Masking rules, policies, and execution logs
DOB dataops-dob-service Freshness, volume, schema monitoring, and SLA
DAU dataops-dau-service Audit logs, data changes, and compliance reports
USR dataops-usr-service Authentication, users, roles, and access control

Quick Start

mvn -DskipTests package
cp .env.example .env
docker compose up -d --build
docker compose ps

Requirements: JDK 17+, Maven 3.9+, Docker Compose, MySQL 8.x, and Redis 7.x.

The idempotent showcase dataset is in sql/xnet_dataops_demo.sql. It uses non-routable addresses and invalid placeholder credentials, and preserves user-created records.

Demo

The fixed code is only for the public showcase. Production must use secure authentication.

Community and License

XnetDataops is part of OpenXnet. Issues and pull requests are welcome.

Released under the MIT License. Copyright © 2026 SynapXnet.