Built using the foundational Data_pipeline.sql for customer data cleaning, standardization, and quality flagging. Aligns with the $128.96B AI-Powered CRM market (9.48% CAGR).
- Copy env file:
cp .env.example .env - Start services:
docker-compose up --build - Access:
- Dashboard: http://localhost:8501
- API docs: http://localhost:8000/docs
- Create
.envfrom.env.example - Install dependencies:
pip install -r requirements.txt - Initialize DB:
python src/pipeline_runner.py - Start API:
uvicorn src.main:app --reload - Start Dashboard:
streamlit run dashboard/app.py
Leverages all original Data_pipeline.sql logic:
- Data quality checks (email/age/phone/city validation)
- Deduplication by customer_id + email
- Text standardization (INITCAP, TRIM, LOWER)
- Missing value handling (COALESCE)
- Invalid record filtering
- Enrichment (full_name, days_since_registration)
- Data quality flags (Complete/Incomplete) for AI governance
sql/ # Database schemas and pipeline SQL
src/ # FastAPI backend + pipeline runner
dashboard/ # Streamlit CRM dashboard
- Automated data pipeline processing
- Customer data quality metrics
- AI-powered basic lead scoring
- RESTful API for CRM data access