Codex/extract data from csv file

README.md

@@ -1,7 +1,7 @@
 # AI Automations
 Intelligent AI automations using the Bito CLI and other tools.  Please use them or customize them to your needs!
 
-Four intelligent automations are available currently:
+Five intelligent automations are available currently:
 
 ## [Documentation](https://github.com/gitbito/AI-Automation/tree/main/documentation/)
 Several different automations. Provide Bito CLI a directory and it will automatically provide a detailed overview, visualization, and documentation for each file including summary of the file, dependencies, documentation regarding class/modules, function/methods, etc.  Works in over 50+ programming languages, and documentation can be generated in over 50 spoken languages (English, German, Chinese, etc).
@@ -18,6 +18,11 @@ This Python script uses the Bito CLI to generate release notes based on the diff
 ## [Generate Commit Messages](https://github.com/gitbito/AI-Automation/tree/main/git/commit_msg)
 Generate commit messages given a repo path.
 
+
+
+## [Objective Data Manager](./operations/objective_data_manager)
+Build and maintain an objective-focused datastore that tracks permissions, submissions, government-guaranteed lending records, a full file inventory (size, timestamps, hashes), linked file placement plans, and progressive execution steps. Useful for organizing execution data, exporting all records, and proving what was submitted and when.
+
 ## Prerequisites
 
 Bito CLI, available [here](https://github.com/gitbito/CLI).

operations/objective_data_manager/README.md

@@ -0,0 +1,42 @@
+# Objective Data Manager
+
+A lightweight CLI to collect and maintain the data needed to execute objectives:
+
+- objective definitions
+- permission/authorization records
+- submission tracking
+- government guarantee lending records
+- full file inventory (name, size, modified time, hash)
+- file-to-objective linking for situation-specific placement
+- complete data export (`get-all-data`)
+- progressive execution steps for acceleration (`add-execution-step`)
+- authority and control matrix records (`add-control-matrix`)
+
+## Usage
+
+From the repository root:
+
+```bash
+python3 operations/objective_data_manager/objective_data_manager.py --store objective_data.json add-objective --id OBJ-001 --summary "Organize and execute submissions" --owner "Operations"
+python3 operations/objective_data_manager/objective_data_manager.py --store objective_data.json add-permission --objective OBJ-001 --granted-by "Agency" --scope "Submit on behalf of org"
+python3 operations/objective_data_manager/objective_data_manager.py --store objective_data.json add-submission --objective OBJ-001 --title "Q2 filing" --status "in_progress" --destination "Portal"
+python3 operations/objective_data_manager/objective_data_manager.py --store objective_data.json add-lending-item --objective OBJ-001 --borrower "Small Business A" --amount 250000 --guarantee-type "SBA 7(a)" --status "pending"
+python3 operations/objective_data_manager/objective_data_manager.py --store objective_data.json add-execution-step --objective OBJ-001 --step-id STEP-01 --title "Prepare submission package" --status "in_progress" --priority 10
+python3 operations/objective_data_manager/objective_data_manager.py --store objective_data.json add-execution-step --objective OBJ-001 --step-id STEP-02 --title "Submit through authorized portal" --status "pending" --priority 20
+python3 operations/objective_data_manager/objective_data_manager.py --store objective_data.json update-step-status --objective OBJ-001 --step-id STEP-02 --status "in_progress"
+python3 operations/objective_data_manager/objective_data_manager.py --store objective_data.json add-control-matrix --pon "1984" --tas "Authorized" --approval-authority "Program Office" --execution-systems "Authorized Treasury systems" --custody "Regulated financial institutions" --oversight "Treasury, OMB, GAO"
+python3 operations/objective_data_manager/objective_data_manager.py --store objective_data.json index-files --root .
+python3 operations/objective_data_manager/objective_data_manager.py --store objective_data.json link-file --objective OBJ-001 --file-path "docs/filings/Q2.pdf" --situation "Quarterly filing" --target-location "submissions/quarterly" --notes "Upload first"
+python3 operations/objective_data_manager/objective_data_manager.py --store objective_data.json organize-plan --objective OBJ-001
+python3 operations/objective_data_manager/objective_data_manager.py --store objective_data.json get-all-data
+python3 operations/objective_data_manager/objective_data_manager.py --store objective_data.json summary
+```
+
+## Notes
+
+- Run `index-files` whenever your working files change and you need a refreshed inventory.
+- Use `link-file` to map files to objective situations and target placement locations.
+- Use `organize-plan` to produce a grouped placement plan by `target_location`.
+- Use `add-execution-step` + `update-step-status` to drive progressive action plans and track active execution.
+- Use `add-control-matrix` to preserve authority/control metadata for compliance evidence.
+- The datastore is plain JSON so it can be reviewed, versioned, or synced into a larger workflow.

operations/objective_data_manager/government_guarantee_packet/00_Governance/data_dictionary.md

@@ -0,0 +1,9 @@
+# Data Dictionary
+
+- `record_id`: Permanent unique identifier for each record.
+- `source_file`: Original intake artifact (unaltered).
+- `structured_data`: JSON extraction from source.
+- `verification_artifact`: Evidence of authenticity and signer validation.
+- `control_evidence`: Proof of compliance and policy execution.
+- `submission_packet`: Final assembled files ready for submission.
+- `audit_package`: Full lifecycle evidence archive.

operations/objective_data_manager/government_guarantee_packet/01_Master_Index/approvals_log.csv

@@ -0,0 +1,5 @@
+approval_id,record_id,approval_stage,approver_name,approver_role,status,decision_date,notes
+A-001,TREASURY-2025-08-28-SNAPPCREDITCOM-ACCEPTANCE,Authenticity,[],Compliance Lead,Pending,,
+A-002,TREASURY-2025-08-28-SNAPPCREDITCOM-ACCEPTANCE,Legal Review,[],Counsel,Pending,,
+A-003,TREASURY-2025-08-28-SNAPPCREDITCOM-ACCEPTANCE,Compliance Signoff,[],Compliance Director,Pending,,
+A-004,TREASURY-2025-08-28-SNAPPCREDITCOM-ACCEPTANCE,Submission Authorization,[],Program Director,Pending,,

operations/objective_data_manager/government_guarantee_packet/01_Master_Index/submission_register.csv

@@ -0,0 +1,2 @@
+record_id,date_received,agency,office,program,counterparty,document_type,subject,signature_validated,attachments_complete,trigger_event_required,trigger_event_date,deadline_rule,computed_due_date,owner,legal_status,compliance_status,risk_level,current_status,next_action,evidence_path,last_updated
+TREASURY-2025-08-28-SNAPPCREDITCOM-ACCEPTANCE,2025-08-28,United States Department of the Treasury,CDFI Programs,Certified CDFI programs,SNAPPCREDITCOM (Non-Profit),Agency Letter,Acceptance of Treasury Bond Pledge for Triggered Guarantees,N,N,Y,,+60 days from realized payout,,Primary Owner,Pending,Pending,Medium,Received,Verify authenticity and collect attachments,02_Agency_Correspondence/Treasury/2025/2025-08-28_Treasury_AcceptanceBondPledge_SNAPPCREDITCOM,2026-04-08

operations/objective_data_manager/government_guarantee_packet/02_Agency_Correspondence/Treasury/2025/2025-08-28_Treasury_AcceptanceBondPledge_SNAPPCREDITCOM/02_Extracted/treasury_letter_structured_data.json

@@ -0,0 +1,31 @@
+{
+  "record_id": "TREASURY-2025-08-28-SNAPPCREDITCOM-ACCEPTANCE",
+  "document_type": "Government Agency Letter",
+  "agency_name": "United States Department of the Treasury",
+  "agency_address": "1500 Pennsylvania Avenue NW, Washington, D.C. 20220",
+  "document_date_iso": "2025-08-28",
+  "recipient": {
+    "organization": "SNAPPCREDITCOM (Non-Profit)",
+    "care_of": "Enzo Caprelli",
+    "address": "700 E Lake Dr, Unit 11, Orange, CA 92866-2732"
+  },
+  "subject": "Acceptance of Treasury Bond Pledge for Triggered Guarantees",
+  "key_terms": [
+    "Treasury accepts pledge of U.S. Treasury bonds.",
+    "Face value equals outstanding loan amounts for triggered guarantees.",
+    "Bonds may be held or banked until maturity.",
+    "Bond attachment information due within 60 days of any realized payout.",
+    "Treasury incurs no loss and obligations remain fully secured."
+  ],
+  "signatory": {
+    "name": "Jane M. Thornton",
+    "title": "Director, CDFI Programs"
+  },
+  "signature_status": "Placeholder observed in provided image",
+  "cc": [
+    "Office of Financial Institutions, Treasury Department"
+  ],
+  "attachments_mentioned": [
+    "Supporting documents describing the general guarantee framework and project outlines"
+  ]
+}

operations/objective_data_manager/government_guarantee_packet/02_Agency_Correspondence/Treasury/2025/2025-08-28_Treasury_AcceptanceBondPledge_SNAPPCREDITCOM/03_Verification/authenticity_check_notes.md

@@ -0,0 +1,22 @@
+# Authenticity Check Notes
+
+- Record ID: TREASURY-2025-08-28-SNAPPCREDITCOM-ACCEPTANCE
+- Date opened: 2026-04-08
+- Analyst: [Name]
+
+## Checks Performed
+1. Agency address format check
+2. Signatory identity check
+3. Official contact callback/email confirmation
+4. Letter metadata consistency
+5. Signature status check
+
+## Findings
+- [ ] Confirmed authentic
+- [ ] Pending confirmation
+- [ ] Inconsistent indicators found
+
+## Signature Review
+- Observed text: [Signature Placeholder]
+- Executed signature present? [Yes/No]
+- Action taken: [Describe]

operations/objective_data_manager/government_guarantee_packet/02_Agency_Correspondence/Treasury/2025/2025-08-28_Treasury_AcceptanceBondPledge_SNAPPCREDITCOM/04_Legal_Compliance/compliance_checklist.md

@@ -0,0 +1,25 @@
+# Compliance Checklist — Treasury Bond Pledge Acceptance
+
+## Document Identity
+- [ ] Record ID assigned
+- [ ] Source file preserved (unaltered)
+- [ ] OCR/transcription completed
+- [ ] Structured data file created
+
+## Authenticity
+- [ ] Issuing agency verified via official channel
+- [ ] Sender identity verified
+- [ ] Signature validated (or executed copy requested)
+- [ ] Verification evidence logged
+
+## Terms Validation
+- [ ] Coverage term confirmed (face value = outstanding triggered amounts)
+- [ ] Holding/banking-until-maturity term confirmed
+- [ ] 60-day reporting requirement captured
+- [ ] No-loss / fully-secured obligation captured
+
+## Operational Readiness
+- [ ] Trigger event defined (realized payout)
+- [ ] Due-date rule configured (+60 days)
+- [ ] Reminder schedule configured (D+30, D+45, D+55, D+60)
+- [ ] Responsible owner assigned

operations/objective_data_manager/government_guarantee_packet/02_Agency_Correspondence/Treasury/2025/2025-08-28_Treasury_AcceptanceBondPledge_SNAPPCREDITCOM/04_Legal_Compliance/policy_mapping.csv

@@ -0,0 +1,6 @@
+clause_id,document_clause,control_owner,control_action,evidence_required,frequency,status
+C-001,Treasury accepts pledge of U.S. Treasury bonds,Legal,Validate acceptance language and enforceability,Legal memo + review notes,One-time,Open
+C-002,Face value equals outstanding triggered loan amounts,Finance,Reconcile pledge values to outstanding balances,Reconciliation workbook + signoff,Per trigger event,Open
+C-003,Bonds may be held or banked until maturity,Treasury Ops,Track custody/holding records,Custody statements,Monthly,Open
+C-004,Bond attachment information due within 60 days of realized payout,Compliance,Monitor payout events and deadline submissions,Submission receipt + timestamp,Per payout event,Open
+C-005,Treasury incurs no loss / obligations fully secured,Risk,Validate collateral sufficiency and guarantee conditions,Risk assessment report,Per trigger event,Open

operations/objective_data_manager/government_guarantee_packet/02_Agency_Correspondence/Treasury/2025/2025-08-28_Treasury_AcceptanceBondPledge_SNAPPCREDITCOM/06_Actions/task_tracker.csv

@@ -0,0 +1,4 @@
+task_id,record_id,task_name,task_description,owner,priority,status,start_date,due_date,completed_date,dependencies,evidence_file
+T-001,TREASURY-2025-08-28-SNAPPCREDITCOM-ACCEPTANCE,Verify authenticity,Confirm issuer and document legitimacy via official Treasury channel,Compliance Lead,High,Open,2026-04-08,2026-04-10,,None,03_Verification/authenticity_check_notes.md
+T-002,TREASURY-2025-08-28-SNAPPCREDITCOM-ACCEPTANCE,Obtain final signed copy,Request executed signed version if placeholder copy only,Legal Lead,High,Open,2026-04-08,2026-04-12,,T-001,03_Verification/signature_validation_log.csv
+T-003,TREASURY-2025-08-28-SNAPPCREDITCOM-ACCEPTANCE,Collect referenced attachments,Obtain guarantee framework and project outline attachments,Operations Lead,High,Open,2026-04-08,2026-04-11,,T-001,05_Attachments_Referenced/

operations/objective_data_manager/government_guarantee_packet/03_Agreements/templates/auto_charge_and_collateral_security_agreement.md

@@ -0,0 +1,70 @@
+# AUTO CHARGE AND COLLATERAL SECURITY AGREEMENT
+
+This Auto Charge and Collateral Security Agreement ("Agreement") is made effective as of [Effective Date], by and between [Secured Party Legal Name] ("Secured Party") and [Borrower Legal Name] ("Borrower").
+
+## 1. Definitions
+- **Obligations**: All debts, liabilities, and payment obligations under the Loan Documents.
+- **Collateral**: All assets described in this Agreement and any proceeds of those assets.
+- **Designated Accounts**: Deposit and investment accounts identified in Schedule A.
+- **Collateral Accounts**: Accounts and assets identified in Schedule B.
+- **Trigger Event**: Any event described in Section 5.
+
+## 2. Grant of Security Interest
+Borrower grants Secured Party a continuing security interest in the Collateral, including Designated Accounts, Collateral Accounts, and all related proceeds, to secure all Obligations.
+
+## 3. Auto Charge Authorization
+Borrower authorizes Secured Party to initiate ACH debits, wire transfers, account sweeps, and other charge mechanisms permitted under applicable law for amounts due under the Loan Documents.
+
+## 4. Payment Waterfall
+1. Costs, fees, and expenses
+2. Accrued interest
+3. Past-due principal
+4. Current principal
+5. Reserve and guarantee reimbursement
+6. Other Obligations
+
+## 5. Trigger Events
+- Scheduled payment due dates
+- Missed payment beyond the agreed grace period
+- Breach of affirmative or negative covenants
+- Cross-default under other loan or guarantee agreements
+- Insolvency, bankruptcy, or similar event
+- Guarantee payout or reimbursement event
+- Execution of the Agreement by Borrower
+
+## 6. Notice
+Secured Party will provide Borrower notice of any post-charge activity within [60] business days, unless a shorter or longer period is required by applicable law.
+
+## 7. Borrower Covenants
+Borrower agrees to maintain active accounts, keep sufficient balances, and execute any additional documents necessary to perfect and maintain Secured Party's security interest.
+
+## 8. Perfection and Control
+Borrower authorizes Secured Party to file UCC financing statements and execute control agreements or other perfection documents as required.
+
+## 9. Setoff
+Secured Party may exercise any setoff rights permitted by applicable law against Borrower accounts and Collateral.
+
+## 10. Governing Law and Venue
+Governing law: [State]. Venue: [County/State/Federal District].
+
+## 11. Signature Blocks
+The parties agree to execute signature blocks for:
+- Secured Party authorized signatory
+- Borrower authorized signatory
+
+## Schedule A — Designated Deposit Accounts
+| Bank | Account Title | Last 4 | Routing | Method | Frequency | Limit |
+|---|---|---:|---|---|---|---|
+| [Bank Name] | [Account Title] | [Last 4] | [Routing Number] | [ACH/Wire/Sweep] | [Frequency] | [Limit] |
+
+## Schedule B — Collateral Accounts
+| Custodian | Account ID | Asset Type | Control Agreement | Lien Priority | Notes |
+|---|---|---|---|---|---|
+| [Custodian] | [Account ID] | [Asset Type] | [Executed/Pending] | [1st/2nd] | [Notes] |
+
+## Schedule C — Trigger Matrix
+| Trigger | Evidence | Approval | Notice | Owner |
+|---|---|---|---|---|
+| Scheduled Payment | Payment schedule | Automatic | [Notice Timing] | [Owner] |
+| Default | Delinquency report | [Approver] | Within [X] days | [Owner] |
+| Guarantee Payout | Payout report | [Approver] | Within [X] days | [Owner] |

operations/objective_data_manager/government_guarantee_packet/03_Agreements/templates/borrower_authorization_certificate.md

@@ -0,0 +1,22 @@
+# Borrower Authorization Certificate
+
+I, [Name], as [Title] of [Borrower Legal Name], hereby certify that:
+
+1. I am duly authorized to execute the Auto Charge and Collateral Security Agreement on behalf of [Borrower Legal Name].
+2. The governing body of [Borrower Legal Name] has duly approved the Agreement on [Approval Date].
+3. The account and collateral schedules attached to the Agreement are true, complete, and correct to the best of my knowledge.
+4. I have full authority to bind [Borrower Legal Name] with respect to all obligations and representations made in the Agreement.
+
+Signature: _______________________________
+
+Name: [Name]
+Title: [Title]
+Date: _______________________________
+
+Witness:
+
+Signature: _______________________________
+
+Name: [Witness Name]
+Title: [Witness Title]
+Date: _______________________________

operations/objective_data_manager/government_guarantee_packet/03_Agreements/templates/notice_addresses.md

@@ -0,0 +1,15 @@
+# Notice Addresses
+
+## Secured Party Notices
+- Name/Department: [Secured Party Name] / [Department]
+- Email: [securedparty@example.com]
+- Address: [Street Address]
+- City/State/ZIP: [City, State ZIP]
+- Phone: [Phone Number]
+
+## Borrower Notices
+- Name/Department: [Borrower Legal Name] / [Department]
+- Email: [borrower@example.com]
+- Address: [Street Address]
+- City/State/ZIP: [City, State ZIP]
+- Phone: [Phone Number]

operations/objective_data_manager/government_guarantee_packet/03_Agreements/templates/pdf_packet_manifest.md

@@ -0,0 +1,12 @@
+# PDF Packet Manifest (Assembly Order)
+
+1. Cover page (record ID, date, parties)
+2. Auto Charge and Collateral Security Agreement (full text)
+3. Schedule A — Designated Deposit Accounts
+4. Schedule B — Collateral Accounts
+5. Schedule C — Trigger Matrix
+6. Borrower Authorization Certificate
+7. Notice Addresses
+8. Signature Pages
+9. Control Agreements (DACA/SACA), if applicable
+10. UCC filing copies, if applicable

operations/objective_data_manager/government_guarantee_packet/README.md

@@ -0,0 +1,14 @@
+# Government Guarantee Lending Document Packet
+
+This folder contains a ready-to-use packet for organizing submissions related to collateralized lending and government-guarantee workflows.
+
+## Included
+- Master indexes and trackers (`01_Master_Index`).
+- Extracted source document records for the August 28, 2025 Treasury letter (`02_Agency_Correspondence/...`).
+- Legal/compliance checklists and policy mappings.
+- A full Auto Charge and Collateral Security Agreement template packet (`03_Agreements/templates`).
+
+## Notes
+- Replace all bracketed placeholders before execution.
+- Validate all legal language with licensed counsel.
+- Treat any unsigned or placeholder-signature documents as unverified until authenticated.