Skip to content

About

Towards Long-Horizon Vision-Language-Action System: Reasoning, Acting and Memory

Resources

Stars

12 stars

Watchers

0 watching

Forks

Latest commit

 

History

6 Commits

Folders and files

NameName
Last commit message
Last commit date
 
 
 
 
 
 
 
 

Repository files navigation

   

Towards Long-Horizon Vision-Language-Action System:  Reasoning, Acting and Memory

📝 Paper   🤗 Model   🛢️ Dataset

Overview

MindExplore is a hierarchical embodied intelligence system including reasoning, acting, and memory, offering state-of-the-art generalizability in highly dynamic scenes. Unlike conventional planar embodied intelligence models that consolidate all capabilities within a single layer, MindExplore introduces a novel expert-level hierarchical embodied system architecture.

Installation

  1. Clone this repo
  2. Environment
  3. Dataset

Fine-Tune

MMDP Training

Acknowledge

This work builds upon the foundation established by iDP3, and we express our sincere appreciation to the authors for making their implementation publicly available. We also acknowledge the use of the ms-swift framework during training, which provided essential support for the development and evaluation of our approach.

Citation

License

All the code, model weights, and data are licensed under MIT license.

About

Towards Long-Horizon Vision-Language-Action System: Reasoning, Acting and Memory

Resources

Stars

12 stars

Watchers

0 watching

Forks

Releases

Packages

Contributors

Languages