Post installation, gemini insights `procedure not found`

[iampatgrady]

in the post installation guide (after doing a colab install), running:

## Backfill for gemini insights
CALL `feature_store.invoke_backfill_user_scoped_metrics`();
CALL `gemini_insights.invoke_backfill_user_behaviour_revenue_insights`();

throws this error:

Procedure is not found: `gemini_insights.invoke_backfill_user_behaviour_revenue_insights` at [2:6]

We'd expect to run that line with no issues (following the directions)

[nrkfeller]

🤖 Devin AI Analysis Started

I'm analyzing this issue to provide a detailed action plan and confidence score.

Session Details:

• Session ID: devin-9c987fe660d74ceba264861ba9219e44
• Session URL: View Progress

I'll post the results here once the analysis is complete (typically within 10-30 minutes).

[nrkfeller]

⚠️ Devin Session Blocked

The Devin session devin-9c987fe660d74ceba264861ba9219e44 is currently blocked and may require user input or intervention.

Please check the Devin session to see what input is needed.

[nrkfeller]

🤖 Devin AI Analysis Started

I'm analyzing this issue to provide a detailed action plan and confidence score.

Session Details:

• Session ID: devin-dfbc7b0651b34a21b2d20e865e053372
• Session URL: View Progress

I'll post the results here once the analysis is complete (typically within 10-30 minutes).

[nrkfeller]

🤖 Devin Analysis Results

1. Sync Fork with Upstream:

git remote add upstream https://github.com/GoogleCloudPlatform/marketing-analytics-jumpstart.git
git fetch upstream
git merge upstream/main

2. Verify Gemini Insights Files: Confirm presence of the new SQL procedures and Terraform configurations for the gemini_insights dataset.
3. Redeploy Infrastructure: Run terraform plan and terraform apply to deploy the missing gemini_insights infrastructure.
4. Test Post-Installation Commands:

CALL `feature_store.invoke_backfill_user_scoped_metrics`();
CALL `gemini_insights.invoke_backfill_user_behaviour_revenue_insights`();

Confidence Score: 98%

---

Session ID: devin-9c987fe660d74ceba264861ba9219e44
Analysis completed at: 2025-07-31 03:25:39 UTC

[nrkfeller]

🤖 Devin Analysis Results

1. Immediate Fix: Update the main branch's post-installation documentation (<ref_file file="/home/ubuntu/repos/marketing-analytics-jumpstart/infrastructure/terraform/README.md" />) to remove references to the non-existent gemini_insights procedure.
2. Branch Management Decision: Decide whether to:

• Option A: Merge the gemini insights branch into main to enable this functionality.
• Option B: Keep gemini insights as experimental and clarify its availability in documentation.

Confidence Score: 95%

---

Session ID: devin-dfbc7b0651b34a21b2d20e865e053372
Analysis completed at: 2025-07-31 03:25:39 UTC

[nrkfeller]

🤖 Devin Analysis Results

Step 1: Verify Documentation Source

• Action: Confirm where the user found the reference to gemini_insights.invoke_backfill_user_behaviour_revenue_insights
• Reason: The procedure call doesn't appear in the current repository's post-installation guide
• Outcome: Determine if this is from outdated documentation, a different branch, or external source

Step 2: Use Correct Procedures

• Action: Replace the problematic procedure call with the correct feature store procedures
• Implementation: Use only the procedures listed in the official post-installation guide:

CALL `feature_store.invoke_backfill_customer_lifetime_value_label`();
CALL `feature_store.invoke_backfill_purchase_propensity_label`();
CALL `feature_store.invoke_backfill_user_dimensions`();
CALL `feature_store.invoke_backfill_user_lifetime_dimensions`();
CALL `feature_store.invoke_backfill_user_lookback_metrics`();
CALL `feature_store.invoke_backfill_user_rolling_window_lifetime_metrics`();
CALL `feature_store.invoke_backfill_user_rolling_window_metrics`();
CALL `feature_store.invoke_backfill_user_scoped_lifetime_metrics`();
CALL `feature_store.invoke_backfill_user_scoped_metrics`();
CALL `feature_store.invoke_backfill_user_scoped_segmentation_metrics`();
CALL `feature_store.invoke_backfill_user_segmentation_dimensions`();
CALL `feature_store.invoke_backfill_user_session_event_aggregated_metrics`();

Step 3: Verify Available Datasets

• Action: Check BigQuery console to confirm which datasets were actually created during installation
• Expected: Should see feature_store, customer_lifetime_value, purchase_propensity, and audience_segmentation datasets
• Not Expected: No gemini_insights dataset should exist

Step 4: Update Documentation (if needed)

• Action: If the incorrect procedure reference exists in any documentation, update it to reference only the implemented procedures
• Target: Ensure all documentation aligns with the actual implementation

Step 5: Alternative Implementation (if insights functionality is needed)

• Action: If user behavior revenue insights are specifically required, this would need to be implemented as a new feature
• Scope: Would require creating new SQL procedures, BigQuery datasets, and Terraform resources
• Timeline: Significant development effort (multiple days/weeks)

---

Session ID: devin-3e74187902cb4adbbbd24ae0c5c3ebb7
Analysis completed at: 2025-07-31 03:25:39 UTC

[nrkfeller]

🤖 Devin Analysis Results

1. Confirm gemini_insights dataset absence in BigQuery.
2. Check git history for any removed gemini insights code.
3. Add gemini_insights dataset and procedures to Terraform and SQL following existing patterns.
4. Update config files accordingly.
5. Deploy and test the new procedures.
6. Fix documentation to match actual infrastructure.

---

Session ID: devin-c012bc6adedc4e78bbe43bdd562fb3ed
Analysis completed at: 2025-07-31 03:25:39 UTC

[nrkfeller]

🤖 Devin AI Analysis Started

I'm analyzing this issue to provide a detailed action plan and confidence score.

Session Details:

• Session ID: devin-7654d27ccbe94369bf0a3a485eb69b73
• Session URL: View Progress

I'll post the results here once the analysis is complete (typically within 10-30 minutes).

[nrkfeller]

🤖 Devin Analysis Results

Phase 1: Infrastructure Foundation

• Add gemini_insights dataset configuration to <ref_file file="/home/ubuntu/repos/marketing-analytics-jumpstart/config/config.yaml.tftpl" />.
• Update terraform locals in <ref_file file="/home/ubuntu/repos/marketing-analytics-jumpstart/infrastructure/terraform/modules/feature-store/main.tf" /> to include gemini_insights_project_id.
• Create google_bigquery_dataset.gemini_insights resource in <ref_file file="/home/ubuntu/repos/marketing-analytics-jumpstart/infrastructure/terraform/modules/feature-store/bigquery-datasets.tf" />.

Phase 2: SQL Procedure Development

• Create main procedure: <ref_file file="/home/ubuntu/repos/marketing-analytics-jumpstart/sql/procedure/user_behaviour_revenue_insights.sqlx" />.
• Create backfill procedure: <ref_file file="/home/ubuntu/repos/marketing-analytics-jumpstart/sql/query/invoke_backfill_user_behaviour_revenue_insights.sqlx" />.

Phase 3: Terraform Procedure Resources

• Add BigQuery routine resources for both procedures to <ref_file file="/home/ubuntu/repos/marketing-analytics-jumpstart/infrastructure/terraform/modules/feature-store/bigquery-procedures.tf" />.

Phase 4: Table Infrastructure

• Add terraform resources for user_behaviour_revenue_insights_daily, _weekly, and _monthly tables to <ref_file file="/home/ubuntu/repos/marketing-analytics-jumpstart/infrastructure/terraform/modules/feature-store/bigquery-tables.tf" />.
• Add table configurations to <ref_file file="/home/ubuntu/repos/marketing-analytics-jumpstart/config/config.yaml.tftpl" />.

Phase 5: Integration & Testing

• Deploy infrastructure using terraform plan and apply.
• Test procedures and verify data population.
• Validate <ref_file file="/home/ubuntu/repos/marketing-analytics-jumpstart/POST-INSTALLATION.md" />.

Confidence Score: 90%

---

Session ID: devin-7654d27ccbe94369bf0a3a485eb69b73
Analysis completed at: 2025-07-31 03:48:41 UTC

[nrkfeller]

⚠️ Devin Session Status Update

The Devin session devin-9802f57864d14b81a10eefedd6327718 is currently blocked and may require user input. I'll continue monitoring for completion.

Please check the Devin session to see what input is needed.

[nrkfeller]

⚠️ Devin Session Status Update

The Devin session devin-9802f57864d14b81a10eefedd6327718 is currently blocked and may require user input. I'll continue monitoring for completion.

Please check the Devin session to see what input is needed.

[nrkfeller]

⚠️ Devin Session Status Update

The Devin session devin-9802f57864d14b81a10eefedd6327718 is currently blocked and may require user input. I'll continue monitoring for completion.

Please check the Devin session to see what input is needed.

[nrkfeller]

⚠️ Devin Session Status Update

The Devin session devin-9802f57864d14b81a10eefedd6327718 is currently blocked and may require user input. I'll continue monitoring for completion.

Please check the Devin session to see what input is needed.

[nrkfeller]

⚠️ Devin Session Status Update

The Devin session devin-9802f57864d14b81a10eefedd6327718 is currently blocked and may require user input. I'll continue monitoring for completion.

Please check the Devin session to see what input is needed.

[nrkfeller]

⚠️ Devin Session Status Update

The Devin session devin-9802f57864d14b81a10eefedd6327718 is currently blocked and may require user input. I'll continue monitoring for completion.

Please check the Devin session to see what input is needed.