Scope
PM / Head of AI
Matt D. on Feb 6
Build
Engineering
Daniel P. on Feb 19
GRC
Compliance/Legal
Jamie L. on Mar 4
Production
DevOps
Nora P. on Mar 12
Monitoring
Operations
Current owner: Operations
Agents / FinanceBot

FinanceBot

A finance automation agent for reconciliation and report generation.

ID: UA-004Framework: LangChainStage: MonitoringOwner: OperationsBlocked
Builder Details

Stakeholder Gates

Active Workflows

No active workflows for this agent right now.

Approval Chains

FinanceBot cost overrun & accuracy gap

4 participants · 2 hours ago

David Okonkwo·Finance2 days ago
EscalatedLisa Park

FinanceBot cost per run is $1.20 which is 2.4x our target. Reconciliation accuracy is only 50%. At this rate we're burning $36/day for half the value we expected. @Lisa Park flagging this — do we pause or remediate?

Lisa Park·Head of AI1 day ago
AssignedMichael Torres

Moving to Amendment stage. The cost profile is unsustainable and accuracy is too low for finance-critical decisions. @Michael Torres can you scope an optimisation sprint? Key targets: cost per run < $0.50, accuracy > 85%.

Michael Torres·DevOps12 hours ago
Requested reviewDavid Okonkwo

Scoped the optimisation sprint. Two main levers: (1) Switch from GPT-4o to GPT-4o-mini for the reconciliation check pass — saves ~60% of LLM cost with minimal accuracy impact on structured data. (2) Reduce the document retrieval context window from 8k to 4k tokens — the financial data we're processing rarely exceeds 2k anyway. Estimated new cost per run: $0.38–$0.44.

Carol Zhang·Operations2 hours ago
AssignedMichael Torres

Ops team notified. I've added a note to the weekly ops report. @Michael Torres — do you need any infra changes for the model switch or is that a config update?

Finance deficit flag — 3 consecutive periods

3 participants · 2 hours ago

Michael Torres·DevOpsyesterday
EscalatedLisa Park

FinanceBot flagged a deficit in the Q1 close reconciliation — the automated variance analysis found a $42K gap between the GL balance and the sub-ledger for cost centre 4210. This is the 3rd consecutive period with a variance in this cost centre. Escalating for manual review.

Lisa Park·Head of AI2 hours ago
AssignedCarol Zhang

Acknowledged. This cost centre variance is a known issue — it's related to the timing difference on the quarterly accrual entries. Finance are aware and are manually adjusting. @Carol Zhang can you add a note to the FinanceBot config to exclude cost centre 4210 from the variance alert threshold for Q1 close?

Applied Policies

PII Redaction
Mask sensitive user data before any external call
Last triggered: Mar 28 - Passed
Enabled
Budget Cap ($200/mo)
Cap spend at $200 per month
Last triggered: Mar 28 - Passed
Enabled
Service Allowlist
Restrict runtime to approved MCP connections
Last triggered: Mar 28 - Passed
Enabled
Hallucination Check
Verifier pass required before external output
Last triggered: Mar 27 - Passed
Enabled
Human Escalation Threshold
Escalate when confidence falls below configured guardrail
Last triggered: Mar 27 - Triggered
Enabled

Audit Trail

Mar 27
Jamie L. flagged Security/Legal gate
Jamie L. · Mar 27
Credential rotation requested
Mar 24
Daniel P. flagged Engineering gate
Daniel P. · Mar 24
Report accuracy below target
Mar 12
Nora P. signed off Production stage
Nora P. · Mar 12
Agent moved into Monitoring
Mar 4
Jamie L. signed off GRC stage
Jamie L. · Mar 4
Agent cleared for production