Skip to content

TheFausap/RECURR

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

9 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Neuralese Recurrence Implementation

This project demonstrates the core concepts from the CONCEPT.md document, implementing an AI architecture based on neuralese recurrence principles.

Overview

Neuralese recurrence is an advanced AI concept where models process information using high-dimensional internal vector representations (neuralese) and feed those thoughts back into themselves, rather than relying on human-readable text. This allows continuous, non-linear reasoning that vastly increases efficiency and depth.

Key Concepts Implemented

  1. Neuralese Vectors: High-dimensional internal representations
  2. Intra-pass Recurrence: Information loops within a single forward pass
  3. Cross-pass Memory Buffers: Storage subsystems for caching intermediate reasoning
  4. Efficient Processing: No translation overhead between layers

Implementation Details

The implementation includes:

  • NeuraleseVector: High-dimensional vector representations
  • RecurrentLayer: Implements intra-pass recurrence with feedback loops
  • CrossPassMemoryBuffer: Memory subsystem for caching thought vectors
  • NeuraleseRecurrenceModel: Main model combining all concepts

Running the Demo

python neuralese_recurrence.py

This will execute a demonstration showing how the model processes input through:

  1. High-dimensional internal representations
  2. Intra-pass recurrence mechanisms
  3. Cross-pass memory usage
  4. Efficient processing without translation overhead

Architecture Benefits

  • No Translation Overhead: Direct processing in high-dimensional space
  • Efficient Reasoning: Complex concepts handled natively
  • Long Thoughts: Massive serial operations possible without token breaking
  • Scalable Design: Configurable dimensions and recurrence depth

About

No description, website, or topics provided.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

 
 
 

Contributors

Languages