INSIGHT · US
BNY Mellon avoids 'tokenmaxxing' trend; tracks alternative AI performance metrics
BNY Mellon deliberately bypassed the industry trend of optimizing only token throughput and latency, instead tracking broader operational and business-outcome metrics for AI deployment. Signals sophistication in LLM procurement and evaluation.
WHY IT MATTERS
Validates that raw model performance metrics (tokens/sec) mislead ROI; enterprise banks now demanding task-completion accuracy, cost-per-transaction, and risk-adjusted KPIs—forcing vendor evals to shift away from pure benchmark scores.
Source: Fortune · 2026-07-28