Pangram verdict · v3.3
We believe that this entire text is AI.
AI likelihood · overall
AIArticle text · 1,494 words · 1 segments analyzed
Timestral is Mistral’s new family of models for forecasting time series. Give it a sequence of numbers, such as daily sales or electricity demand, and it predicts what comes next. It also produces a range of possible values, so we can ask how uncertain the forecast is.The family runs from 5 million to 209 million parameters and supports multiple related series and extra inputs. We were interested in the 28-million-parameter version: small enough to run locally, and already trained across other time series before we gave it our market data.We tested Timestral on daily stock returns, trading volume and a measure of volatility, then fine-tuned the model on older market data. The whole experiment ran on a 16 GB M2 MacBook Air, without a GPU.Volume gave us the clearest result. In our 2026 research note, the original Timestral-28M reduced fifth-session stock log-volume error by 4.70% against a conditional regression. Fine-tuning moved that to 4.94%, but the direct comparison gave us little reason to prefer the adapted model. Returns were much less encouraging.The six charts below expand the single figure in that three-page note.What we forecastedWe downloaded daily market data from Yahoo from 2010 onward. The main panel contained fourteen U.S. stocks, including Apple, Microsoft, JPMorgan, Exxon and Coca-Cola, plus three equity funds: SPY, QQQ and IWM. We kept three other funds out of fine-tuning and model selection to test transfer later.At each forecast date, the model received the preceding 512 completed daily observations. We scored its prediction for the next trading session and for the fifth session ahead.A fifth-session return means the daily return on that future day, rather than the cumulative return over the next five days.TargetWhat we measuredSimple forecasts to beatReturnsDaily log return from adjusted closing pricesZero, past mean and past medianVolumeLog of one plus daily trading volumeLast observed volume, a rolling median and a regressionRange volatilityA log-transformed measure based on the day’s high and lowA regression using recent daily, weekly and monthly rangesWe used logarithms for volume because trading activity can vary enormously across companies and dates. They also stop the largest volume spikes from dominating the error calculation. For each asset, we compared the model’s average absolute error with the baseline’s, then gave every asset equal weight.A 4.70% improvement here means a reduction in that log-volume error measure. It does not mean a 4.70% investment return, or even a 4.70% reduction in error measured in shares.The volatility target uses the Parkinson high–low range estimator. It captures how far prices moved within the daily range. It leaves out overnight jumps and is different from volatility calculated from intraday returns.Keeping training behind the test datesWe began by running the original model without further training, usually called zero-shot forecasting. Then we asked whether adapting it to recent financial history would help.For each test year, training used five older years of labels. The following year was reserved for choosing among saved model versions, called checkpoints. Only after that did we score the forecasts on the test year.Test periodTraining labelsCheckpoint selection20232017–2021202220242018–2022202320252019–2023202420262020–20242025We tested 150 forecast dates across 2023–2025, spaced five trading sessions apart. A separate 2026 snapshot gave us forty dates from 2 January to 13 October. The final fifth-session outcome fell on 20 October.Each training run started again from the same original weights. We updated all 27.8 million parameters for 500 steps and compared checkpoints at steps 0, 100, 250 and 500 using the earlier validation year. The original model at step zero was allowed to win. It did so in three of the 27 historical selections.We repeated this for three targets, four test years and three training-order seeds, giving 36 runs. For each target and year, we combined the three selected forecasts by taking their median at each predicted probability level. The seeds changed the order of training examples; they did not give us three new market histories.Every fourth update trained on groups of related series, although the forecasts reported here used one series at a time. We kept one training recipe rather than searching many settings until something looked good.The uncertainty bars in the charts come from resampling blocks of forecast dates, keeping assets together on each date. They are descriptive 95% intervals from 1,000 resamples. They do not repeat training or adjust for the many comparisons. They help show how stable a result is across the saved dates; a bar crossing zero includes both an improvement and a deterioration.Timestral stock-volume forecasts were the strongest resultAcross fourteen stocks in our retrospective 2026 evaluation, the original Timestral-28M reduced fifth-session log-volume error by 4.70% against a conditional regression. The descriptive 95% interval ran from 2.08% to 6.98%.The fine-tuned Timestral-28M ensemble reduced the same error by 4.94%, with an interval from 2.76% to 7.11%. The two estimates were close enough that the chart nearly puts them on top of each other.Fine-tuning had helped more in the historical sample. For the next session, the adapted model reduced error by 1.08% against the original, with an interval from 0.49% to 1.69%. That gain did not clearly carry into 2026.Before building a training pipeline, we would first check how far the downloaded weights get us.The baseline can change the headlineUsing yesterday’s volume as tomorrow’s forecast is cheap, but it is not the only cheap forecast available.Our conditional regression used the last log-volume observation, trailing five- and 22-session averages, and a known five-session lag where it added distinct information. It fitted only completed historical pairs inside the same 512-observation window. We added the median past fitted residual to its point forecast.In our 2026 stock-volume comparison, the original Timestral-28M reduced fifth-session log-volume error by 18.58% against the last observed volume. The reduction was 4.70% against conditional regression. Against the past 20-session median, it was 3.20%, with an interval that crossed zero.An 18% improvement sounds much more impressive than 5%. Both came from the same forecasts. The difference was what we asked the model to beat.We added the regression after seeing the early historical volume results, then froze its specification before looking at the adapted-volume and 2026 scores. The older comparisons helped develop the experiment. The reserved period gave us a separate local check of those choices.Timestral beat our regression on this stock-volume comparison. We did not establish that it beats every simple volume rule.Timestral fine-tuning added little in the reserved periodA model can beat a regression while learning almost nothing useful from our additional training. To separate those questions, we compared each task-adapted model directly with the original checkpoint.In our 2026 evaluation, all twelve error comparisons between fine-tuned Timestral-28M and the original model had 95% intervals spanning zero. They covered three tasks, two forecast offsets, and the stock and equity-fund panels.For fifth-session stock volume, the direct improvement was 0.14%, with an interval from a 1.15% deterioration to a 1.48% improvement. We would use that comparison to decide whether to maintain fine-tuned weights.Subtracting the two headline regression scores would give a different number. Each score first divides an asset’s error by its comparator’s error. Changing the comparator changes that denominator, so the direct comparison must be calculated separately.All nine 2026 checkpoint selections preferred a trained candidate on the earlier validation data. That preference still did not produce a clear improvement on the later test. Validation selected what looked best in 2025; it could not guarantee that the advantage would last.We would therefore start a follow-up with the original 28M model. Fine-tuning would need to earn its place through a repeatable gain large enough to matter for the intended use.Returns and volatility told different storiesDaily returns were harder to improve. Across the study, we found no consistent advantage over simple return forecasts. In the 2026 stock panel, the adapted fifth-session forecast was 0.38% worse than the past median.A pretrained model can pick up useful regularities without turning daily price moves into an easy prediction problem. Other financial evaluations of time-series foundation models have also found that favourable model rankings can coexist with small and scattered gains over a random walk.Range volatility was more mixed. The adapted stock forecast beat our HAR-style regression by 2.26% at the fifth-session offset in 2026. The original model already had approximately the same point estimate. For the three equity funds, the adapted model was 5.08% worse than that regression.The HAR approach combines information over daily, weekly and monthly periods. Our version applied that idea to the daily range proxy. It outperformed the adapted model on the equity-fund range forecasts in 2026.We did not convert these forecasts into a trading strategy. There were no simulated fills, transaction costs or profit estimates. Better volume forecasts might eventually help plan execution or allocate capacity, but those uses need their own test.Timestral return intervals were too narrowTimestral predicts quantiles as well as a central forecast. That lets us check whether its uncertainty ranges contain outcomes as often as advertised.A nominal 90% interval should contain roughly nine out of ten observations. In our 2026 stock-return sample, the fine-tuned Timestral-28M’s nominal 90% intervals contained 83.75% of next-session outcomes and 84.11% of fifth-session outcomes. The