Skip to content

Commit 02be2b1

Browse files
authored
Merge pull request #4 from vim89/codex/create-getting-started-guide-and-diagrams
Add quick start guide and architecture overview
2 parents 7b1a402 + 53722c5 commit 02be2b1

4 files changed

Lines changed: 44 additions & 1 deletion

File tree

README.md

Lines changed: 3 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -1,4 +1,7 @@
11
# flowforge
2+
3+
See the [quick start](docs/getting-started-quick.md) and [architecture overview](docs/diagrams/overview.svg).
4+
25
## 🎯 **The brutal truth about Data Engineering today**
36
**Data engineering is broken.** And we're all pretending it's fine.
47

docs/diagrams/overview.svg

Lines changed: 18 additions & 0 deletions
Loading

docs/getting-started-quick.md

Lines changed: 22 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,22 @@
1+
# Quick Start
2+
3+
The smallest possible pipeline in FlowForge.
4+
5+
```scala
6+
import cats.effect.IO
7+
import com.flowforge.core.pipeline._
8+
9+
object QuickStart extends IOApp.Simple {
10+
def run: IO[Unit] =
11+
DataPipelineFactory[IO]
12+
.source(blob"gs://raw/sales.csv")
13+
.contract(SalesContract.strict)
14+
.transform(_.filter(_.amount >= 0))
15+
.quality(nonNull("id") and unique("id"))
16+
.sink(BigQuerySink("analytics.sales"))
17+
.build
18+
.run
19+
}
20+
```
21+
22+
See the [architecture overview](diagrams/overview.svg) for how components fit together.

docs/plan/v100-plan.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -213,7 +213,7 @@ That’s it. If you execute those nine steps, the tag is legit.
213213

214214
**P1 — DX & docs**
215215

216-
* [ ] Quickstart with 4 commands + expected outputs/screenshots.
216+
* [ ] Quickstart with 4 commands + expected outputs/screenshots. See [quick guide](../getting-started-quick.md) and [architecture overview](../diagrams/overview.svg).
217217
* [ ] `mdoc` wired to `examples/` so doc snippets compile in CI.
218218
* [ ] Compatibility matrix (Spark/Delta/Deequ) and limitations (no UNIQUE). ([Delta Lake][4])
219219
* [ ] Comparison page vs Frameless/Dagster/Kedro/Scio—what FlowForge uniquely provides (contracts → enforcement ×3). ([GitHub][9], [Dagster Docs][11], [Kedro][13], [Spotify Open Source][15])

0 commit comments

Comments
 (0)