Skip to content

Add Voice-Based Learning feature for PyBe - #20

Open
tejupriyakukkala-creator wants to merge 2 commits into
vicharanashala:mainfrom
tejupriyakukkala-creator:voice-feature
Open

Add Voice-Based Learning feature for PyBe#20
tejupriyakukkala-creator wants to merge 2 commits into
vicharanashala:mainfrom
tejupriyakukkala-creator:voice-feature

Conversation

@tejupriyakukkala-creator

@tejupriyakukkala-creator tejupriyakukkala-creator commented Jul 26, 2026

Copy link
Copy Markdown

🚀 Feature Overview: Voice-Based Learning for PyBre

This Pull Request transforms PyBre into a conversational AI Python tutor, enabling learners to interact using voice commands, explain code logic verbally, debug errors via speech, and practice mock coding interviews.


🌟 Key Features Introduced

  1. 🎤 Voice Question Assistant:

    • Ask Python questions naturally via voice ("What is recursion?", "Explain list comprehension").
    • AI responds with spoken explanations, beginner-friendly analogies, and code snippets.
  2. 💡 Logic Explanation Assessment:

    • Students verbally explain their solution logic.
    • AI evaluates reasoning clarity, correctness, and efficiency while detecting missing edge cases.
  3. 🎓 AI Spoken Tutor:

    • Conversational Python teaching with real-time text + spoken audio response via Text-to-Speech (TTS).
  4. 🐞 Voice Debugger:

    • Speak code error messages ("My code gives IndexError") alongside Python snippets.
    • AI highlights the problematic line, explains the cause, and provides a spoken fix.
  5. 🗣️ Read Code Aloud:

    • Translates Python code into natural human speech, avoiding literal reading of colons, parens, and syntax symbols.
  6. Interactive Voice Quiz:

    • AI speaks Python questions aloud; students respond verbally.
    • Evaluates spoken answer accuracy and provides immediate concept feedback.
  7. 🎯 Voice Coding Interview Practice:

    • Mock interview sessions covering OOP, data structures, and time complexity.
    • Scores responses on technical accuracy, communication clarity, and confidence.
  8. Accessibility & Multilingual Support:

    • OpenDyslexic Font support for dyslexic learners.
    • High Contrast Theme for visually impaired users.
    • Hands-Free Auto-Listen mode & Screen Reader Announcer (aria-live).
    • Multilingual Options: English, Telugu (తెలుగు), Hindi (हिंदी), Tamil (தமிழ்), Kannada (ಕನ್ನಡ).

🛠️ Technical Implementation Summary

  • Frontend (client/src/components/voice/):

    • VoiceStudio.jsx: Glassmorphic modal holding all 8 voice modes and language/accessibility controls.
    • WaveformVisualizer.jsx: HTML5 Canvas rendering real-time animated frequency waveforms during speech.
    • AudioControls.jsx: Audio playback toolbar with play/pause, speech speed (0.75x–1.5x), and transcript toggles.
    • styles.css: Dark mode glassmorphism UI, accessible fonts, and responsive layout.
  • Backend (server/src/):

    • services/voiceEngine.js: Core AI service providing conversational reasoning, code translation, debugging, logic scoring, and quiz evaluation.
    • routes/voice.js: REST API endpoints for /api/voice/* (ask, assess-logic, debug, read-code, quiz, interview, tts).

⚡ Testing & Verification

  • Verified syntax and execution on Node.js Express backend.
  • Verified client build with Vite.
  • Tested Web Speech Recognition and Web Speech Synthesis across English, Telugu, Hindi, Tamil, and Kannada.

@tejupriyakukkala-creator

Copy link
Copy Markdown
Author

🚀 Feature Overview: Voice-Based Learning for PyBre

This Pull Request transforms PyBre into a conversational AI Python tutor, enabling learners to interact using voice commands, explain code logic verbally, debug errors via speech, and practice mock coding interviews.


🌟 Key Features Introduced

  1. 🎤 Voice Question Assistant:

    • Ask Python questions naturally via voice ("What is recursion?", "Explain list comprehension").
    • AI responds with spoken explanations, beginner-friendly analogies, and code snippets.
  2. 💡 Logic Explanation Assessment:

    • Students verbally explain their solution logic.
    • AI evaluates reasoning clarity, correctness, and efficiency while detecting missing edge cases.
  3. 🎓 AI Spoken Tutor:

    • Conversational Python teaching with real-time text + spoken audio response via Text-to-Speech (TTS).
  4. 🐞 Voice Debugger:

    • Speak code error messages ("My code gives IndexError") alongside Python snippets.
    • AI highlights the problematic line, explains the cause, and provides a spoken fix.
  5. 🗣️ Read Code Aloud:

    • Translates Python code into natural human speech, avoiding literal reading of colons, parens, and syntax symbols.
  6. Interactive Voice Quiz:

    • AI speaks Python questions aloud; students respond verbally.
    • Evaluates spoken answer accuracy and provides immediate concept feedback.
  7. 🎯 Voice Coding Interview Practice:

    • Mock interview sessions covering OOP, data structures, and time complexity.
    • Scores responses on technical accuracy, communication clarity, and confidence.
  8. Accessibility & Multilingual Support:

    • OpenDyslexic Font support for dyslexic learners.
    • High Contrast Theme for visually impaired users.
    • Hands-Free Auto-Listen mode & Screen Reader Announcer (aria-live).
    • Multilingual Options: English, Telugu (తెలుగు), Hindi (हिंदी), Tamil (தமிழ்), Kannada (ಕನ್ನಡ).

🛠️ Technical Implementation Summary

  • Frontend (client/src/components/voice/):

    • VoiceStudio.jsx: Glassmorphic modal holding all 8 voice modes and language/accessibility controls.
    • WaveformVisualizer.jsx: HTML5 Canvas rendering real-time animated frequency waveforms during speech.
    • AudioControls.jsx: Audio playback toolbar with play/pause, speech speed (0.75x–1.5x), and transcript toggles.
    • styles.css: Dark mode glassmorphism UI, accessible fonts, and responsive layout.
  • Backend (server/src/):

    • services/voiceEngine.js: Core AI service providing conversational reasoning, code translation, debugging, logic scoring, and quiz evaluation.
    • routes/voice.js: REST API endpoints for /api/voice/* (ask, assess-logic, debug, read-code, quiz, interview, tts).

⚡ Testing & Verification

  • Verified syntax and execution on Node.js Express backend.
  • Verified client build with Vite.
  • Tested Web Speech Recognition and Web Speech Synthesis across English, Telugu, Hindi, Tamil, and Kannada.

1 similar comment
@tejupriyakukkala-creator

Copy link
Copy Markdown
Author

🚀 Feature Overview: Voice-Based Learning for PyBre

This Pull Request transforms PyBre into a conversational AI Python tutor, enabling learners to interact using voice commands, explain code logic verbally, debug errors via speech, and practice mock coding interviews.


🌟 Key Features Introduced

  1. 🎤 Voice Question Assistant:

    • Ask Python questions naturally via voice ("What is recursion?", "Explain list comprehension").
    • AI responds with spoken explanations, beginner-friendly analogies, and code snippets.
  2. 💡 Logic Explanation Assessment:

    • Students verbally explain their solution logic.
    • AI evaluates reasoning clarity, correctness, and efficiency while detecting missing edge cases.
  3. 🎓 AI Spoken Tutor:

    • Conversational Python teaching with real-time text + spoken audio response via Text-to-Speech (TTS).
  4. 🐞 Voice Debugger:

    • Speak code error messages ("My code gives IndexError") alongside Python snippets.
    • AI highlights the problematic line, explains the cause, and provides a spoken fix.
  5. 🗣️ Read Code Aloud:

    • Translates Python code into natural human speech, avoiding literal reading of colons, parens, and syntax symbols.
  6. Interactive Voice Quiz:

    • AI speaks Python questions aloud; students respond verbally.
    • Evaluates spoken answer accuracy and provides immediate concept feedback.
  7. 🎯 Voice Coding Interview Practice:

    • Mock interview sessions covering OOP, data structures, and time complexity.
    • Scores responses on technical accuracy, communication clarity, and confidence.
  8. Accessibility & Multilingual Support:

    • OpenDyslexic Font support for dyslexic learners.
    • High Contrast Theme for visually impaired users.
    • Hands-Free Auto-Listen mode & Screen Reader Announcer (aria-live).
    • Multilingual Options: English, Telugu (తెలుగు), Hindi (हिंदी), Tamil (தமிழ்), Kannada (ಕನ್ನಡ).

🛠️ Technical Implementation Summary

  • Frontend (client/src/components/voice/):

    • VoiceStudio.jsx: Glassmorphic modal holding all 8 voice modes and language/accessibility controls.
    • WaveformVisualizer.jsx: HTML5 Canvas rendering real-time animated frequency waveforms during speech.
    • AudioControls.jsx: Audio playback toolbar with play/pause, speech speed (0.75x–1.5x), and transcript toggles.
    • styles.css: Dark mode glassmorphism UI, accessible fonts, and responsive layout.
  • Backend (server/src/):

    • services/voiceEngine.js: Core AI service providing conversational reasoning, code translation, debugging, logic scoring, and quiz evaluation.
    • routes/voice.js: REST API endpoints for /api/voice/* (ask, assess-logic, debug, read-code, quiz, interview, tts).

⚡ Testing & Verification

  • Verified syntax and execution on Node.js Express backend.
  • Verified client build with Vite.
  • Tested Web Speech Recognition and Web Speech Synthesis across English, Telugu, Hindi, Tamil, and Kannada.

@tejupriyakukkala-creator

Copy link
Copy Markdown
Author

🚀 Voice-Based Learning Studio for PyBre

This PR transforms PyBre into a conversational AI Python tutor, allowing learners to interact using voice, explain code logic verbally, debug errors via speech, and practice mock coding interviews.

🌟 Key Features Added:

  1. 🎤 Voice Question Assistant: Ask Python questions naturally via voice ("What is recursion?", "Explain list comprehension").
  2. 💡 Logic Explanation Assessment: Verbally explain solution logic and get evaluated on reasoning clarity, correctness, and missing edge cases.
  3. 🎓 AI Spoken Tutor: Conversational Python teaching with real-time text + spoken audio response via Text-to-Speech (TTS).
  4. 🐞 Voice Debugger: Speak code error messages ("My code gives IndexError") to get line-by-line spoken fixes and code suggestions.
  5. 🗣️ Read Code Aloud: Translates Python code into natural human speech, avoiding literal reading of colons, parens, and syntax symbols.
  6. ❓ Interactive Voice Quiz: AI speaks Python questions aloud; students respond verbally for immediate concept feedback.
  7. 🎯 Voice Coding Interview Practice: Mock interview sessions covering OOP, data structures, and time complexity with response scoring.
  8. ♿ Accessibility & Multilingual Support: Dyslexic Font support, High Contrast Theme, Hands-Free Auto-Listen mode, and support for English, Telugu, Hindi, Tamil, and Kannada.

🛠️ Technical Details:

  • Frontend (React + Vite): VoiceStudio modal, HTML5 Canvas waveform visualizer, audio playback controls, accessible styling.
  • Backend (Node.js + Express): AI voice engine service for conversational reasoning, code translation, debugging, logic scoring, and quiz evaluation

tejupriyakukkala-creator

This comment was marked as duplicate.

@tejupriyakukkala-creator

Copy link
Copy Markdown
Author

voice feature learning assisstence

tejupriyakukkala-creator

This comment was marked as duplicate.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant