The GIFT-Eval Paradox: Why Nine Compound Agents Defeated Google's TimesFM 3

Google released TimesFM 3, an advanced 330-million-parameter time-series foundation model trained on one trillion time-indexed data points.

In standardized benchmark evaluations, the model achieved the highest ranking among all pre-trained foundation models, securing an impressive 87.2% win rate on Amazon’s Fev Bench.

Yet on the comprehensive GIFT-Eval forecasting leaderboard, TimesFM 3 finished in tenth place. Nine compound agentic systems outperformed Google’s flagship model. The result captures a decisive inflection point across quantitative machine learning: a monolithic foundation model, regardless of parameter scale or pretraining corpus, consistently loses to a compound agent system that analyzes data distributions, evaluates multiple forecasting techniques, and iteratively inspects its own residuals.

TimesFM 3: Single-Pass Forecasting on a Trillion Data Points

TimesFM 3 introduces major architectural improvements over traditional autoregressive forecasters. Rather than predicting subsequent time intervals sequentially, the model structures incoming time series into discrete patches of 32 values, projecting placeholders across the entire requested horizon in a single forward pass.

The architecture also incorporates structured future covariates:

  • Exogenous variable conditioning: The model conditions forecasts on deterministic future events, such as promotional calendars, scheduled maintenance windows, and meteorological predictions. In retail benchmarks, integrating promotion schedules allowed the model to predict a 20% demand surge.
  • Quantile distribution outputs: For every forecasted interval, TimesFM 3 outputs nine distinct probabilistic outcomes spanning the 10th through 90th percentiles, providing integrated confidence intervals alongside point predictions.

On Amazon’s Fev Bench, TimesFM 3 achieved an overall skill score of 48.7 compared with 47.3 for Kronos 2, defeating Kronos 2 on 69% of 100 evaluated tasks and outperforming its 2025 predecessor on 88% of tasks. On the Time benchmark covering 98 distinct datasets, it led the leaderboard with a reduced error metric of 0.640.

The Agentic Inversion on GIFT-Eval: Procedure Beats Pretraining

Despite leading isolated foundation model benchmarks, TimesFM 3 struggled against composite workflows on GIFT-Eval, averaging a rank of 26.0 across diverse operational tasks.

The nine systems ranked above TimesFM 3 were not larger foundation models. They were agentic scaffolding systems powered by general-purpose reasoning models:

  • Algorithmic triage: Rather than forcing every dataset into a neural transformer, the agent inspects seasonality, trend stationarity, and noise characteristics.
  • Multi-model selection: The system selects the optimal tool for that specific distribution, comparing classical statistical models like ARIMA and exponential smoothing against gradient-boosted trees and foundation models.
  • Iterative error checking: The agent fits candidate models on rolling backtests, measures residual errors, and blends forecasts.

A procedural workflow that selects the right model consistently defeats a single monolithic model attempting to generalize across all time series. Orchestration and verification outperform raw pretraining scale.

The Speed and License Tax: Why Kronos 2 Wins in Production

In production environments, inference latency and licensing terms dictate deployment feasibility. While TimesFM 3 won on aggregate benchmark scores, its operational characteristics impose steep production penalties:

  • Concurrency and latency drag: Processing 100 concurrent time series took 3.7 seconds for TimesFM 3, compared with 0.8 seconds for Kronos 2 and 0.27 seconds for Tyrex 2. Furthermore, its cross-series variate attention is capped at 32 series.
  • Restrictive licensing: The model weights are governed by the TimesFM Non-Commercial License 1.0. While academic research and internal benchmarking are permitted, commercial deployments, customer-facing features, and revenue-generating operations are explicitly prohibited.

For commercial engineering teams, Kronos 2 remains the pragmatic operational default. It is nearly three times smaller, four times faster, delivers unencumbered commercial licensing, and trails TimesFM 3 by just 1.4 skill points on Google’s own benchmark suite.

Self-Hosted Sandboxes and Background Agent Automation

While analytical models tackle numerical forecasting, software development agents are expanding from local terminals into enterprise execution environments. Cursor introduced self-hosted cloud agent infrastructure, allowing autonomous agents to execute inside customer-managed virtual machines and sandboxes powered by Daytona and Namespace.

This enables coding agents to interact with private internal microservices and database replicas without compromising corporate security perimeters. Simultaneously, Anthropic expanded background computer use within Claude Code and Cowork, enabling agents to execute UI workflows, manipulate browser DOMs, and compile applications asynchronously in the background. As AI systems migrate from isolated chat prompts to compound production environments, the winning strategy centers on modular execution, strict sandboxing, and procedural verification.