Skip to content

Add semantic occupancy dashboard - #203

Open
riita10069 wants to merge 98 commits into
autowarefoundation:mainfrom
riita10069:codex/semantic-occupancy-dashboard-pr
Open

Add semantic occupancy dashboard#203
riita10069 wants to merge 98 commits into
autowarefoundation:mainfrom
riita10069:codex/semantic-occupancy-dashboard-pr

Conversation

@riita10069

@riita10069 riita10069 commented Aug 21, 2026

Copy link
Copy Markdown
Collaborator

Add a semantic occupancy dashboard with model provenance, camera evidence, and a shared 3D renderer.
The dashboard defaults to a 0.20 confidence threshold and displays object counts as values.
See the deployed experience: https://d2itskdqq39tx1.cloudfront.net/occupancy

@riita10069
feat(console): model semantic occupancy artifact descriptors in the API
2edf283 
Signed-off-by: riita10069 <ryota10069.tech5.jizi@gmail.com>
@riita10069
feat(console): validate and stream immutable occupancy artifacts from S3
e0c3bc1 
Signed-off-by: riita10069 <ryota10069.tech5.jizi@gmail.com>
@riita10069
feat(console): serve semantic occupancy overlays for selected models
5d1a81a 
Signed-off-by: riita10069 <ryota10069.tech5.jizi@gmail.com>
@riita10069
feat(console): register semantic occupancy overlay endpoint
3c5c2e7 
Signed-off-by: riita10069 <ryota10069.tech5.jizi@gmail.com>
@riita10069
feat(console): parse quantized semantic occupancy artifacts in the br…
b5f1906 
…owser

Signed-off-by: riita10069 <ryota10069.tech5.jizi@gmail.com>
@riita10069
feat(console): fetch semantic occupancy artifacts through the console…
bfc577a 
… API

Signed-off-by: riita10069 <ryota10069.tech5.jizi@gmail.com>
@riita10069
feat(console): render occupancy prediction teacher and error views
fbe9b29 
Signed-off-by: riita10069 <ryota10069.tech5.jizi@gmail.com>
@riita10069
feat(console): integrate occupancy diagnostics into episode playback
58bca3b 
Signed-off-by: riita10069 <ryota10069.tech5.jizi@gmail.com>
@riita10069
test(console): cover occupancy binary rendering and view switching
24d4a2f 
Signed-off-by: riita10069 <ryota10069.tech5.jizi@gmail.com>
@riita10069
feat(console): add React Three Fiber runtime for semantic scenes
6c4570a 
Signed-off-by: riita10069 <ryota10069.tech5.jizi@gmail.com>
@riita10069
build(console): lock Three.js scene dependencies reproducibly
604e224 
Signed-off-by: riita10069 <ryota10069.tech5.jizi@gmail.com>
@riita10069
feat(console): extract bounded semantic scene components
4a80e6b 
Signed-off-by: riita10069 <ryota10069.tech5.jizi@gmail.com>
@riita10069
test(console): verify semantic component extraction geometry
ce72886 
Signed-off-by: riita10069 <ryota10069.tech5.jizi@gmail.com>
@riita10069
feat(console): add procedural autonomous scene models
9157a96 
Signed-off-by: riita10069 <ryota10069.tech5.jizi@gmail.com>
@riita10069
feat(console): render semantic occupancy as interactive WebGL
fb37a24 
Signed-off-by: riita10069 <ryota10069.tech5.jizi@gmail.com>
@riita10069
fix(console): expose the WebGL scene to accessibility checks
379eb95 
Signed-off-by: riita10069 <ryota10069.tech5.jizi@gmail.com>
@riita10069
test(console): validate semantic WebGL pixels and presets
19ef306 
Signed-off-by: riita10069 <ryota10069.tech5.jizi@gmail.com>
@riita10069
feat(console): give semantic actors reflective detailed bodies
11ead2f 
Signed-off-by: riita10069 <ryota10069.tech5.jizi@gmail.com>
@riita10069
feat(console): light semantic actors with procedural reflections
63c49d0 
Signed-off-by: riita10069 <ryota10069.tech5.jizi@gmail.com>
@riita10069
docs(console): preserve Kenney CC0 license for asset auditability
dcae07e 
Signed-off-by: riita10069 <ryota10069.tech5.jizi@gmail.com>
@riita10069
docs(console): record 3D asset provenance and checksums for review
db58925 
Signed-off-by: riita10069 <ryota10069.tech5.jizi@gmail.com>
@riita10069
feat(console): bundle the CC0 model palette for offline rendering
e2f6a89 
Signed-off-by: riita10069 <ryota10069.tech5.jizi@gmail.com>
@riita10069
feat(console): bundle a CC0 crate for recognized obstacles
1773b46 
Signed-off-by: riita10069 <ryota10069.tech5.jizi@gmail.com>
@riita10069
feat(console): bundle a CC0 cone for compact obstacles
737cde4 
Signed-off-by: riita10069 <ryota10069.tech5.jizi@gmail.com>
@riita10069
feat(console): bundle a distinctive CC0 ego vehicle
0cdaa7b 
Signed-off-by: riita10069 <ryota10069.tech5.jizi@gmail.com>
@riita10069
feat(console): bundle a CC0 sedan for nearby traffic
392d3ba 
Signed-off-by: riita10069 <ryota10069.tech5.jizi@gmail.com>
@riita10069
feat(console): bundle a CC0 SUV for larger traffic objects
378abef 
Signed-off-by: riita10069 <ryota10069.tech5.jizi@gmail.com>
@riita10069
feat(console): bundle a CC0 van for long traffic objects
b652eef 
Signed-off-by: riita10069 <ryota10069.tech5.jizi@gmail.com>
@riita10069
feat(console): render semantic actors with local CC0 models
35e57ef 
Signed-off-by: riita10069 <ryota10069.tech5.jizi@gmail.com>
@riita10069
feat(console): add reflective terrain and responsive sky framing
f3d11eb 
Signed-off-by: riita10069 <ryota10069.tech5.jizi@gmail.com>
@riita10069
fix(console): serve occupancy from model-set manifests
620501a 
Signed-off-by: riita10069 <ryota10069.tech5.jizi@gmail.com>
@riita10069
feat(console): route occupancy model discovery
141dab0 
Signed-off-by: riita10069 <ryota10069.tech5.jizi@gmail.com>
@riita10069
refactor(console): remove overlay-bound occupancy lookup
50e090f 
Signed-off-by: riita10069 <ryota10069.tech5.jizi@gmail.com>
@riita10069
feat(console): type occupancy model provenance
d83a722 
Signed-off-by: riita10069 <ryota10069.tech5.jizi@gmail.com>
@riita10069
feat(console): fetch independent occupancy models
85547cd 
Signed-off-by: riita10069 <ryota10069.tech5.jizi@gmail.com>
@riita10069
feat(console): add KITScenes occupancy dashboard
a0a79d2 
Signed-off-by: riita10069 <ryota10069.tech5.jizi@gmail.com>
@riita10069
feat(console): navigate to occupancy dashboard
238fdb3 
Signed-off-by: riita10069 <ryota10069.tech5.jizi@gmail.com>
@riita10069
test(console): verify occupancy dashboard WebGL
a308940 
Signed-off-by: riita10069 <ryota10069.tech5.jizi@gmail.com>
@riita10069
test(console): isolate occupancy screenshots from dev chrome
52c1f6d 
Signed-off-by: riita10069 <ryota10069.tech5.jizi@gmail.com>
@riita10069
feat(console): expose occupancy producer provenance
50b28eb 
Signed-off-by: riita10069 <ryota10069.tech5.jizi@gmail.com>
@riita10069
feat(console): consume occupancy set schema v2
8076ad5 
Signed-off-by: riita10069 <ryota10069.tech5.jizi@gmail.com>
@riita10069
test(console): verify independent occupancy identities
8d045c2 
Signed-off-by: riita10069 <ryota10069.tech5.jizi@gmail.com>
@riita10069
feat(console): type occupancy producer provenance
3a223f2 
Signed-off-by: riita10069 <ryota10069.tech5.jizi@gmail.com>
@riita10069
feat(console): disclose occupancy licenses and recipe
af68638 
Signed-off-by: riita10069 <ryota10069.tech5.jizi@gmail.com>
@riita10069
test(console): verify occupancy provenance display
65d6a20 
Signed-off-by: riita10069 <ryota10069.tech5.jizi@gmail.com>
@riita10069
fix(console): show occupancy detections at publication threshold
a0f4132 
Signed-off-by: riita10069 <ryota10069.tech5.jizi@gmail.com>
@riita10069
fix(console): align occupancy camera evidence
a390242 
Signed-off-by: riita10069 <ryota10069.tech5.jizi@gmail.com>
@riita10069
test(console): scroll camera evidence before image assertions
a8b3612 
Signed-off-by: riita10069 <ryota10069.tech5.jizi@gmail.com>
@riita10069
assets(console): preserve distributed Kenney license formatting
1b25e04 
Signed-off-by: riita10069 <ryota10069.tech5.jizi@gmail.com>
@riita10069
riita10069 force-pushed the codex/semantic-occupancy-dashboard-pr branch from 0aa13f7 to 1b25e04 Compare August 21, 2026 12:14
@riita10069
riita10069 marked this pull request as ready for review August 21, 2026 15:50
@riita10069

riita10069 commented Aug 21, 2026

Copy link
Copy Markdown
Collaborator Author

The CI failure was not caused by the dashboard changes

@riita10069

riita10069 commented Aug 21, 2026

Copy link
Copy Markdown
Collaborator Author

The changes are limited to Tools/ only, with no modifications to models or pipelines.
Simply visualizing the Occupancy of BEVFormer2 and AutoE2E

@riita10069
feat(console): honor occupancy model class support
f3cd46e 
Signed-off-by: riita10069 <ryota10069.tech5.jizi@gmail.com>
@riita10069
feat(console): label HENet lane dividers
c58e524 
Signed-off-by: riita10069 <ryota10069.tech5.jizi@gmail.com>
@riita10069
test(console): cover HENet occupancy selection
af54776 
Signed-off-by: riita10069 <ryota10069.tech5.jizi@gmail.com>
@riita10069
test(console): scope occupancy visual capture
2b36ec4 
Signed-off-by: riita10069 <ryota10069.tech5.jizi@gmail.com>
@riita10069
test(console): capture stable occupancy viewport
4a131be 
Signed-off-by: riita10069 <ryota10069.tech5.jizi@gmail.com>
@riita10069
test(console): assert HENet class subset
25e5664 
Signed-off-by: riita10069 <ryota10069.tech5.jizi@gmail.com>
@riita10069
test(console): allow WebGL dashboard render time
ca17a87 
Signed-off-by: riita10069 <ryota10069.tech5.jizi@gmail.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

1 participant

@riita10069