Skip to content

Folders and files

NameName
Last commit message
Last commit date

Latest commit

Β 

History

12 Commits
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 

Repository files navigation

title Smart MCQ Solver β€” DeBERTa-v3-large
emoji 🧠
colorFrom indigo
colorTo blue
sdk gradio
sdk_version 5.16.0
app_file app.py
pinned false
license mit

🧠 Smart MCQ Solver · DeBERTa-v3 Multi-Model Engine

HuggingFace Space Model Repo MAP@3 Score IIT Madras BS Python 3.9+ Gradio

A state-of-the-art Multiple Choice Question (MCQ) Answering System fine-tuned on DeBERTa-v3-large (0.4B parameters) and DeBERTa-v3-base (0.2B parameters) using PyTorch. Built for high-accuracy inference with MAP@3 validation score of 1.0000.


πŸ“Œ Executive Summary & Project Overview

This repository contains the complete inference pipeline, multi-model Gradio web application, and fine-tuned model integration for answering 5-option multiple-choice questions.

🌟 Key Highlights:

  • Primary Model (DeBERTa-v3-large): 435M parameter transformer model fine-tuned on MCQ datasets using sequence classification scoring.
  • Fast Variant (DeBERTa-v3-base): 86M parameter lightweight model for fast real-time inference.
  • Dual Inference Engine: Direct local PyTorch GPU/CPU inference with automatic fallback to Hugging Face Serverless Router API.
  • Interactive Full-Width Dashboard: Gradio 5.x user interface with soft-max confidence bar charts, MAP@3 ranking order, test suite validation, and 100% responsive layout.

πŸ—‚οΈ Professional Project Directory Structure

Smart-MCQ-Solver-DeBERTa/
β”‚
β”œβ”€β”€ app.py                          # πŸš€ Main Gradio multi-model web application & inference engine
β”œβ”€β”€ requirements.txt                # πŸ“¦ Python dependencies (torch, transformers, gradio, etc.)
β”œβ”€β”€ README.md                       # πŸ“– Full documentation with badges & benchmark table
β”œβ”€β”€ LICENSE                         # βš–οΈ  MIT Open Source License
β”‚
β”œβ”€β”€ config/                         # βš™οΈ  Deployment & server configuration
β”‚   └── render.yaml                 # Render cloud deployment configuration
β”‚
β”œβ”€β”€ docs/                           # πŸ“š Project documentation
β”‚   β”œβ”€β”€ README.md                   # Documentation index & key links
β”‚   └── architecture.md             # Model pipeline diagram & training config
β”‚
└── deberta_v3_large/               # πŸ€– Fine-tuned model weights & tokenizer
    β”œβ”€β”€ config.json                 # Model architecture hyperparameters
    β”œβ”€β”€ tokenizer.json              # DeBERTa-v3 Fast Tokenizer vocabulary
    β”œβ”€β”€ tokenizer_config.json       # Tokenizer settings & special tokens
    └── model.safetensors           # PyTorch fine-tuned weights (~1.74 GB, gitignored)

πŸ“Š Model Evaluation & Benchmarks

Model Architecture Parameters Evaluation Metric Score Inference Speed Primary Use Case
Shitanshu06/mcq-deberta-v3-large 0.4B (435M) MAP@3 1.0000 βœ… ~1.2s Main High-Accuracy Solver
Shitanshu06/mcq-deberta-v3-best-v2 0.2B (86M) MAP@3 0.9420 ~0.4s Fast Lightweight Variant

πŸš€ Quickstart & Local Installation

1. Clone Repository

git clone https://github.com/24f2006167/Smart-MCQ-Solver-DeBERTa.git
cd Smart-MCQ-Solver-DeBERTa

2. Create Virtual Environment & Install Dependencies

python3 -m venv venv
source venv/bin/activate
pip install -r requirements.txt

3. Launch Web Application

python3 app.py

Open http://localhost:7860 in your browser to access the application.


πŸ‘¨β€πŸŽ“ Author & Academic Context

  • Author: Shitanshu Chaurasiya
  • Roll Number: 24F2006167
  • Institution: IIT Madras BS Degree in Data Science and Applications
  • Course: Deep Learning & GenAI (T2-2026 Term)
  • Live Hugging Face Space: Shitanshu06/smart-mcq-solver

πŸ“„ License

This project is licensed under the MIT License.

About

🧠 High-Performance Multi-Model DeBERTa-v3 (0.4B & 0.2B) MCQ Answering Engine with Gradio 5.x Web Interface. MAP@3 Score: 1.0000.

Topics

Resources

Stars

0 stars

Watchers

0 watching

Forks

Releases

Packages

Contributors

Languages