feat(alpasim-integration): add alpasim driver plugin for closed-loop operation - #166
feat(alpasim-integration): add alpasim driver plugin for closed-loop operation#166Arseni10Lk wants to merge 2277 commits into
Conversation
Signed-off-by: riita10069 <ryota10069.tech5.jizi@gmail.com>
Signed-off-by: riita10069 <ryota10069.tech5.jizi@gmail.com>
Signed-off-by: riita10069 <ryota10069.tech5.jizi@gmail.com>
Signed-off-by: riita10069 <ryota10069.tech5.jizi@gmail.com>
Signed-off-by: riita10069 <ryota10069.tech5.jizi@gmail.com>
Signed-off-by: riita10069 <ryota10069.tech5.jizi@gmail.com>
Signed-off-by: riita10069 <ryota10069.tech5.jizi@gmail.com>
Signed-off-by: riita10069 <ryota10069.tech5.jizi@gmail.com>
Signed-off-by: riita10069 <ryota10069.tech5.jizi@gmail.com>
Signed-off-by: riita10069 <ryota10069.tech5.jizi@gmail.com>
Signed-off-by: riita10069 <ryota10069.tech5.jizi@gmail.com>
Signed-off-by: riita10069 <ryota10069.tech5.jizi@gmail.com>
Signed-off-by: riita10069 <ryota10069.tech5.jizi@gmail.com>
Signed-off-by: riita10069 <ryota10069.tech5.jizi@gmail.com>
Signed-off-by: riita10069 <ryota10069.tech5.jizi@gmail.com>
Signed-off-by: riita10069 <ryota10069.tech5.jizi@gmail.com>
Signed-off-by: riita10069 <ryota10069.tech5.jizi@gmail.com>
Signed-off-by: riita10069 <ryota10069.tech5.jizi@gmail.com>
Signed-off-by: riita10069 <ryota10069.tech5.jizi@gmail.com>
Signed-off-by: riita10069 <ryota10069.tech5.jizi@gmail.com>
Signed-off-by: riita10069 <ryota10069.tech5.jizi@gmail.com>
Signed-off-by: riita10069 <ryota10069.tech5.jizi@gmail.com>
Signed-off-by: riita10069 <ryota10069.tech5.jizi@gmail.com>
Signed-off-by: riita10069 <ryota10069.tech5.jizi@gmail.com>
Signed-off-by: riita10069 <ryota10069.tech5.jizi@gmail.com>
Signed-off-by: riita10069 <ryota10069.tech5.jizi@gmail.com>
Signed-off-by: riita10069 <ryota10069.tech5.jizi@gmail.com>
Signed-off-by: riita10069 <ryota10069.tech5.jizi@gmail.com>
Signed-off-by: riita10069 <ryota10069.tech5.jizi@gmail.com>
Signed-off-by: riita10069 <ryota10069.tech5.jizi@gmail.com>
Signed-off-by: riita10069 <ryota10069.tech5.jizi@gmail.com>
Signed-off-by: riita10069 <ryota10069.tech5.jizi@gmail.com>
Signed-off-by: riita10069 <ryota10069.tech5.jizi@gmail.com>
Signed-off-by: riita10069 <ryota10069.tech5.jizi@gmail.com>
Signed-off-by: riita10069 <ryota10069.tech5.jizi@gmail.com>
Signed-off-by: riita10069 <ryota10069.tech5.jizi@gmail.com>
Signed-off-by: riita10069 <ryota10069.tech5.jizi@gmail.com>
Signed-off-by: riita10069 <ryota10069.tech5.jizi@gmail.com>
Signed-off-by: riita10069 <ryota10069.tech5.jizi@gmail.com>
…t/bev-diagnostics-dashboard Add per-encoder BEV diagnostics to DataModelConsole
…n for issue autowarefoundation#140 Signed-off-by: Arseni10Lk <arseniy230606@gmail.com>
Signed-off-by: Arseni10Lk <arseniy230606@gmail.com>
…ack in test_alpasim_stream.py Signed-off-by: Arseni10Lk <arseniy230606@gmail.com>
…int inference, and attach camera params in stream parser Signed-off-by: Arseni10Lk <arseniy230606@gmail.com>
…ing requirements, and add closed-loop smoke test Signed-off-by: Arseni10Lk <arseniy230606@gmail.com>
…tion example Signed-off-by: Arseni10Lk <arseniy230606@gmail.com>
…tion Signed-off-by: Arseni10Lk <arseniy230606@gmail.com>
Signed-off-by: Arseni10Lk <arseniy230606@gmail.com>
https://github.com/NVlabs/alpasim/blob/main/src/driver/src/alpasim_driver/models/base.py Signed-off-by: Arseni10Lk <arseniy230606@gmail.com>
ee8b7c5 to
9af5d25
Compare
Signed-off-by: Arseni10Lk <arseniy230606@gmail.com>
Signed-off-by: Arseni10Lk <arseniy230606@gmail.com>
Signed-off-by: Arseni10Lk <arseniy230606@gmail.com>
|
Great...! I will review this PR. |
|
I am just making more changes right now (in accordance with the yesterday's meeting), so please give me a second, I will tag you as soon as it is complete |
|
I’m sorry for the disruption. Environment-specific infrastructure identifiers, including instance IDs, were inadvertently committed to the repository history, so we had to rewrite the history and force-push the cleaned branches. This caused this pull request to close automatically. I restored your commits in replacement PR #175 from the sanitized history, with the original commit authorship preserved: Before continuing work, please back up any uncommitted changes outside the repository, remove your existing local clone, and clone the repository again. Reusing or pushing from an old clone could reintroduce the removed history. I apologize for the unexpected closure and the additional review noise. |
Summary
This PR implements the AlpaSim Driver Plugin (
Model/plugins/alpasim_driver/) and the real-time Observation Stream Parser (Model/data_parsing/alpasim_stream/) to resolve #140.It enables closed-loop evaluation and training rollouts of the AutoE2E policy within NVIDIA AlpaSim over the KitScenes 7-camera sensor topology at 10 Hz.
AutoE2EDriver(BaseTrajectoryModelsubclass) andAutoE2EAlpaSimConfig, registeringautoe2eunder Python entry point groupsalpasim.modelsandalpasim.configs.AlpasimStreamParserpreprocessor converting real-timePredictionInputpayloads to normalized model observation tensors.Model/data_parsing/kit_scenes/dataset.py.examples/run_closed_loop.py), local smoke test (smoke_test_alpasim.py), and parity unit tests (test_alpasim_stream.py).Architecture & Data Flow
Registered Entry Points (
pyproject.toml)Validation
alpasim_stream/parser.py(49/49 statements), 84% total coverage across the plugin suite.Acceptance Criteria
Model/data_parsing/alpasim_stream/parser.pyis implemented.Model/tests/verifying parser compliance against offline loader.smoke_test_alpasim.py).Model/plugins/alpasim_driver/examples/run_closed_loop.py).Closes #140
@riita10069 @m-zain-khawaja
P.S. I also added Pillow to our requirements since it is used in the visualization