Error occurred after running the commands in the given order

[ro-ko]

Hi, thanks for your work on this project.
I followed the instructions and executed the commands in the exact order provided, but I encountered the error shown below. Do you happen to know what might be causing this issue?

Any guidance would be greatly appreciated.

INFO: Starting Minecraft process with device: cpu
Gym has been unmaintained since 2022 and does not support NumPy 2.0 amongst other critical functionality.
Please upgrade to Gymnasium, the maintained drop-in replacement of Gym, or contact the authors of your software and request that they upgrade.
Users of this version of Gym should be able to simply replace 'import gym' with 'import gymnasium as gym' in the vast majority of cases.
See the migration guide at https://gymnasium.farama.org/introduction/migration_guide/ for additional information.
ERROR:minestudio.simulator.minerl.env.malmo.instance.f6566c:[16:37:01] [Render thread/WARN]: ERROR : Couldn't load Narrator library : Unable to load library 'fliteWrapper': Can't obtain InputStream for linux-x86-64/libfliteWrapper.so
ERROR:minestudio.simulator.minerl.env.malmo.instance.f6566c:[16:37:02] [Realms Notification Availability checker #1/INFO]: Could not authorize you against Realms server: java.lang.RuntimeException: Failed to parse into SignedJWT: null
ERROR:minestudio.simulator.minerl.env.malmo.instance.f6566c:[16:37:03] [Worker-Main-13/ERROR]: Using missing texture, unable to load minecraft:optifine/ctm/default/empty.png : java.io.FileNotFoundException: minecraft:optifine/ctm/default/empty.png
ERROR:minestudio.simulator.minerl.env.malmo.instance.f6566c:[16:37:03] [Render thread/ERROR]: Error starting SoundSystem. Turning off sounds & music
ERROR:minestudio.simulator.minerl.env.malmo.instance.f6566c:java.lang.IllegalStateException: Failed to open OpenAL device
WARNING:minestudio.simulator.minerl.env.malmo.instance.f6566c:[16:37:03] [Render thread/WARN]: [OptiFine] Missing CTM sprite: minecraft:optifine/ctm/default/empty
WARNING:minestudio.simulator.minerl.env.malmo.instance.f6566c:[16:37:06] [Render thread/WARN]: Ambiguity between arguments [teleport, destination] and [teleport, targets] with inputs: [Player, 0123, @e, dd12be42-52a9-4a91-a8a1-11c01849e498]
WARNING:minestudio.simulator.minerl.env.malmo.instance.f6566c:[16:37:06] [Render thread/WARN]: Ambiguity between arguments [teleport, location] and [teleport, destination] with inputs: [0.1 -0.5 .9, 0 0 0]
WARNING:minestudio.simulator.minerl.env.malmo.instance.f6566c:[16:37:06] [Render thread/WARN]: Ambiguity between arguments [teleport, location] and [teleport, targets] with inputs: [0.1 -0.5 .9, 0 0 0]
WARNING:minestudio.simulator.minerl.env.malmo.instance.f6566c:[16:37:06] [Render thread/WARN]: Ambiguity between arguments [teleport, targets] and [teleport, destination] with inputs: [Player, 0123, dd12be42-52a9-4a91-a8a1-11c01849e498]
WARNING:minestudio.simulator.minerl.env.malmo.instance.f6566c:[16:37:06] [Render thread/WARN]: Ambiguity between arguments [teleport, targets, location] and [teleport, targets, destination] with inputs: [0.1 -0.5 .9, 0 0 0]
WARNING:minestudio.simulator.minerl.env.malmo.instance.f6566c:[16:37:23] [Render thread/WARN]: Failed to load texture: minecraft:optifine/ctm/default/empty.png
ERROR:minestudio.simulator.minerl.env.malmo.instance.f6566c:java.io.FileNotFoundException: minecraft:optifine/ctm/default/empty.png
CommandsCallback(commands=['/give @s minecraft:oak_log 4', '/setblock ~2 ~ ~ minecraft:crafting_table', 'base', '_self_'])
JudgeResetCallback()
Environment reset: 0
RecordCallback()
Traceback (most recent call last):
  File "/home/ubuntu/roko/MCU/MCU_benchmark/run_task.py", line 93, in <module>
    get_video(commands, text, file_path)
  File "/home/ubuntu/roko/MCU/MCU_benchmark/run_task.py", line 61, in get_video
    action, state_in = model.get_steve_action(condition, obs, state_in, input_shape='*')
  File "/home/ubuntu/miniconda3/envs/mcu/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1962, in __getattr__
    raise AttributeError(
AttributeError: 'SteveOnePolicy' object has no attribute 'get_steve_action'```

[grandsmile]

Hello, thank you for your interest in our work.

It might be due to recent changes in the official MineStudio interface. You can refer to:
https://github.com/CraftJarvis/MineStudio/blob/master/minestudio/models/steve_one/body.py

The file includes function call examples, and adjusting the related interfaces may resolve the issue.

[ro-ko]

Thank you for the quick response!

https://github.com/CraftJarvis/MineStudio/blob/master/minestudio/tutorials/inference/evaluate_steve/main.py

After reviewing the code you shared, I found that the error was consistently caused by the order in which callbacks were executed.

Traceback (most recent call last): 
File "/home/ubuntu/roko/MCU/MCU_benchmark/run_task.py", line 189, in <module> get_video(commands, text, file_path) 
File "/home/ubuntu/roko/MCU/MCU_benchmark/run_task.py", line 132, in get_video action, state_in = model.get_action( File "/home/ubuntu/miniconda3/envs/mcu/lib/python3.10/site-packages/torch/utils/_contextlib.py", line 120, in decorate_context return func(*args, **kwargs) 
File "/home/ubuntu/miniconda3/envs/mcu/lib/python3.10/site-packages/minestudio/models/base_policy.py", line 160, in get_action latents, state_out = self.forward(input, state_in, **kwargs) 
File "/home/ubuntu/miniconda3/envs/mcu/lib/python3.10/site-packages/minestudio/models/steve_one/body.py", line 567, in forward condition = input['condition'].copy() KeyError: 'condition'

Depending on the callback ordering, the obs dictionary was being overwritten, which caused the condition field to disappear before reaching the model. Once I moved the CommandCallback to the end of the callback list, the issue was resolved.

For anyone who may encounter a similar problem, here is the callback configuration that worked for me:

env_generator = partial(
    MinecraftSim,
    obs_size=(128, 128),
    preferred_spawn_biome="forest",
    callbacks=(
        [SpeedTestCallback(50),]
        + load_callbacks_from_config(config_file)
        + [CommandCallback("mine log", cond_scale=4.0)]
    )
)

[ro-ko]

I have a question regarding how to use the Steve-1 model.

When providing the condition and text as input, should the value be the task file name, or should it be the text field defined inside the task’s YAML file?

Example:

build_a_library.yaml

custom_init_commands:

• /give @s minecraft:oak_planks 128
• /give @s minecraft:bookshelf 64
• /give @s minecraft:glass_pane 64
• /give @s minecraft:wool 64
• /give @s minecraft:lantern 32
• /give @s minecraft:crafting_table
• /summon villager ~3 ~ ~3 {Profession:"minecraft:librarian",VillagerData:{profession:"minecraft:librarian"}}
• /give @s minecraft:flower_pot 5
  text: build a library with bookshelves and decorative elements
  thinking: '- In order to build a library, you will need a variety of building materials
  such as wood planks, bookshelves, and decorative items like glass panes or wool
  for carpets. You may also want villagers to act as librarians.'

[grandsmile]

For the Steve-1 model, we recommend using the task file name: "build a library". It is relatively short and aligns with the type of input used during Steve-1’s training, making it easier for the model to understand. The content in the "text" field is sometimes too lengthy for Steve-1 to generalize effectively.