Skip to content

chore: re-add baba-is-ai demo to the bundled library #61

Description

@JNK234

Roadmap priority: B16

Summary

Re-add the baba-is-ai demo to the bundled library. It was pulled during the v1.0.0 library submission over a config-file issue flagged in review.

Why it matters

It is one of the more research-grounded demos — it reproduces the knowing-doing gap from BALROG (arXiv:2411.13543), where LLMs score near zero on spatial puzzle games despite being able to state the correct rule. Good demonstration material and a genuine research result.

What needs to be done

  1. Recover the exact reviewer note from the NetLogo-Libraries submission — the issue was an extensionless config file that did not fit the bundle conventions.
  2. Rename or restructure the config so it conforms (compare demos/tests/config.txt.example and the other bundled demos).
  3. Verify the demo runs against a current default model — it was built against Ollama qwen2.5:7b.
  4. Re-run and confirm behaviour still reproduces the intended result.
  5. Re-submit to the library bundle.

Open questions

  • Is the config issue the only blocker, or were there other reviewer notes?
  • Should it ship with an Ollama config (free, offline, matches the original result) or a cloud config (faster to demo)?

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    enhancementNew feature or request

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions