Add PyQt HRI display prototype packageFeature/arlab UI pyqt package - #235
Merged
Conversation
TobiasNeher
approved these changes
Aug 20, 2026
TobiasNeher
left a comment
Collaborator
There was a problem hiding this comment.
- not tested on the actual zirbi hardware
- the Legacy version was removed
- code is commented
- still a prototyp
no further issues with the pyqt6 display implementation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Adds the PyQt-based HRI display prototype package for the UI part of Human-Robot Interaction.
The package implements a first ROS-integrated display prototype based on the previous UI mockup and addresses the open UI integration topics from Design Review 2. The old Tkinter demo UI is kept in
legacy/, while the active prototype is implemented as a PyQt6 application.The display can be started via
ros2 runor the provided launch file and implements the following prototype pipeline:Decision Making / Speech Output
-> publishes speech text on
/tts_output-> display subscribes to
/tts_output-> incoming messages are shown in the Speech Output card
User interaction
-> display buttons publish prototype feedback on
/ui_action-> current actions:
confirm,repeat,cancel-> this is intended as a temporary feedback path until a structured HRI feedback interface is defined
Camera display
-> display subscribes to
/camera_gripper/color/image_raw-> incoming ROS image messages are converted via
cv_bridge-> if no image topic is available, a local placeholder image is shown
The GUI provides:
The current task/status/progress values are represented through an internal
RuntimeState. This is used as a placeholder for the future structured HRI Output Interface from Decision Making.Included:
arlab_uizirbi_displayzirbi_display.launch.pylegacy/