AI4Finance Lab ← Back to the lab

How rigorously is AI for stock prediction tested?

A systematic review of how studies combine financial signals, design AI agents and report the evaluation of their results.

Status
Working paper, in preparation
Team
Reza Kalantarinejad, Amir Amel-Zadeh
Scope
Journal studies, 2015–2026
Sources
Scopus and Web of Science
Why this review

Before building an AI system that fuses financial evidence, we wanted to know how the field already tests such systems.

The review asks three questions: how studies combine fundamental, technical and textual signals; how they design and coordinate AI agents; and how they report the evaluation of their predictions.

How we did it

Three steps.

  1. 1

    Search

    A pre-specified search of journal articles indexed in Scopus and Web of Science, 2015 to 2026.

  2. 2

    Screen and code

    A language-model pipeline screened and coded titles and abstracts, checked against human coding of 198 abstracts.

  3. 3

    Read in full

    Fifty selected studies were read in full to test and explain what the abstract-level coding shows.

Key findings

Methods are advancing faster than evaluation reporting.

775

journal studies reviewed, 727 of them empirical.

9 in 10

empirical studies state no evaluation protocol in their abstract.

< 3%

combine walk-forward testing, an economic measure and transaction costs.

2026

walk-forward reporting rose sharply, in every research question.

Figures describe what studies report in their titles and abstracts. Rounded from the working paper, which is not yet peer reviewed; final figures may differ.

What it means for the lab

The review sets the bar our own systems must clear.

It shapes the design of our multi-agent forecasting work (P2) and is the evidence base for the open evaluation standards we plan to publish (P4).

Publication
2026 · Working paper

Heterogeneous Signal Fusion, Agentic Architecture and Evaluation Rigour in AI-Based Equity Prediction: A Systematic Review

Kalantarinejad, R. and Amel-Zadeh, A. Working paper.

Request the paper