Skip to content

[feature request] Support for Parameterized Action Spaces in Stable-Baselines/SB3 Contrib #1200

Description

@NUrgell

Hi!

I was wondering if there are any plans to support parameterized action spaces in Stable-Baselines or SB3 Contrib. Specifically, I'm referring to action spaces that combine discrete actions with associated continuous parameters—potentially represented using gym.spaces.Tuple or another approach, as described in this paper.

My main goal is to preserve the problem’s parameterized structure rather than discretizing a continuous space. Do you see a pathway for integrating such spaces into SB3?

I came across an earlier discussion on this topic in #100, but I haven't been able to find any recent updates. Is this still planned for version 3.1?

Thanks in advance! :)

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions