Algorithmic Skepticism: How to Trade Based on Mathematics, Not Emotions

- -
- 100%
- +
The financial market is an environment fundamentally hostile to our innate cognitive machinery. Here there is no predator to be spotted in a fraction of a second—there is noise, which our brain stubbornly tries to turn into signal. Here there is none of the linear causality we are accustomed to in everyday life—instead, nonlinear dynamics prevail, in which small causes produce disproportionately large effects and apparent regularities fall apart as soon as the sample of observations is enlarged. The retail trader who sits down at the terminal brings this entire evolutionary burden along, never suspecting how systematically it will fail them.
The problem is not a lack of intelligence or a shortage of knowledge. The problem is that certain errors of reasoning are built in and automatic. They operate at a level beyond the reach of mere willpower. Knowing that a trap exists by no means always protects us from falling into it—this is one of the most unpleasant truths confronting anyone who attempts to move from emotional to systematic trading. In this chapter we will examine six fundamental mechanisms that methodically turn the capital of retail market participants into statistical noise, from which more disciplined players extract their profits.
Belief in Patterns: How the Brain Finds Order Where None ExistsThe deepest and most destructive of all the traps is the pathological tendency of the human mind to find patterns even in purely random data. This mechanism is so fundamental that no conscious effort can fully switch it off. Evolution has tuned the brain to err on the side of seeing a pattern that is not there rather than missing one that is: better to mistake the rustling of leaves for a threat a hundred times than to overlook a real one once. This asymmetry of risk made sense when survival was at stake, but in financial markets it becomes a source of persistent losses.
When a trader looks at a five-minute chart and sees a technical-analysis formation taking shape, something important happens: the brain actively seeks visual confirmation of a hypothesis it already holds, while entirely disregarding the context in which that formation is emerging. It does not ask about the depth of the order book at that moment, about the actual volume behind the move, or about whether current liquidity is sufficient for the formation to carry any predictive value at all. It simply sees a familiar shape and reacts to it as though it were a signal.
What makes this trap especially dangerous is that the overwhelming majority of visual patterns a trader observes on lower timeframes under conditions of insufficient liquidity are not an expression of the collective psychology of market participants, but a byproduct of market maker activity, algorithmic systems, and the random noise of market microstructure. A formation that looks convincing on a chart is often an artifact—the result of a collision between several large orders, bearing no relation whatsoever to any stable regularity in crowd behavior.
Philosophically, this trap is rooted in the profound discomfort the human mind experiences in the face of randomness. We are constitutionally incapable of accepting that a significant share of price movement is the product of pure stochasticity superimposed on structural liquidity constraints. To acknowledge randomness is to acknowledge our own powerlessness to predict the future, and this runs counter to the psyche's basic need for control and certainty. And so the brain readily constructs a narrative to explain any price movement, even when, objectively, no such explanation exists.
Confirmation Bias: The Trader's Selective MemoryThe second pillar of the retail market participant's self-destruction is the tendency to remember selectively the information that confirms a belief already formed, and to forget, just as selectively, everything that contradicts it. This mechanism operates so imperceptibly that the trader remains genuinely unaware of how badly their own statistics are distorted.
Consider a typical situation: a trader uses a particular indicator to enter positions. Over the course of a month, the indicator generates twenty signals, six of which turn out to be profitable and fourteen losing. Yet what lingers in the trader's subjective memory is chiefly those same six successes—they carry a stronger emotional charge, they trigger a dopamine response tied to the sensation of triumph and of being right. The losing trades, by contrast, are pushed out of mind as something uncomfortable, something at odds with their self-image as a competent market participant.
The consequences of this selective remembering are catastrophic: the trader keeps using a statistically unprofitable strategy, sincerely believing in its effectiveness, because their subjective internal ledger of trades diverges radically from the objective transaction log. This is not merely an error of perception—it is a fundamental rupture between reality and its mental representation, one that cannot be repaired without the rigorous, impartial, mechanical recording of every single trade, without exception.
Confirmation bias manifests itself not only in the after-the-fact assessment of results but also in the very process of deciding to enter a position. A trader who has already formed a hypothesis about an asset's direction begins, unconsciously, to search the chart and the news flow only for those signals that support it. A bearish divergence on an oscillator, plainly contradicting a long position, simply fails to register in their conscious mind—it is filtered out as irrelevant information. This creates a vicious circle: the more convinced the trader is that they are right, the less receptive they become to objective data pointing to the contrary.
The Anchoring Effect: The Prison of the Entry PriceThe third trap concerns the distorting influence that an arbitrarily chosen reference point exerts on every subsequent assessment of the situation. The price at which a position was opened becomes, psychologically, an absolute and sacred benchmark around which all of the trader's further analysis begins to revolve, even though, objectively, this price carries no informational value for the market—the market is utterly indifferent to the price at which any particular participant entered a trade.
The anchoring mechanism shows itself in the habit of holding on to losing positions, justified by a formula familiar to anyone who has ever traded: "As soon as the price gets back to my entry, I'll close out at breakeven." This phrase is the very quintessence of the cognitive trap—the trader ignores the entire body of objective data that may have changed since the position was opened: a growing imbalance in the order book, declining volatility that signals the exhaustion of the move, a divergence between momentum and price. Instead of analyzing the current market reality, they keep mentally appealing to an outdated, subjective reference point.
This trap is tantamount to a fundamental methodological error—fitting the facts to a desired, predetermined outcome. Rather than asking the honest question "What do the current data tell me about the likely direction of the move?" the trader asks an entirely different one: "How do I hold out until the moment when I can justify my original decision?" This turns the very logic of analysis on its head, transforming the analytical process into an act of psychological self-defense.
Anchoring takes other forms as well: an all-time high becomes the "fair level" to which the asset is bound to return; a round psychological number is perceived as an insurmountable barrier; a recent local extremum hardens into a rigid benchmark for future moves. In every one of these cases, an arbitrary reference point supplants objective analysis of the liquidity balance and the structure of the market profile.
The Availability Heuristic: The Illusion of Competence After a Winning StreakThe fourth mechanism of self-destruction comes into play when traders begin to judge their own predictive ability solely on the basis of recent events that are readily available in memory, while entirely ignoring the broader and more representative statistical context. After several profitable trades in a row, a dangerous illusion takes hold: good fortune begins to look like the product of acquired skill rather than a favorable confluence of market circumstances.
This trap is especially insidious during periods of sustained directional movement, when practically any trend-following strategy yields a positive result simply by virtue of the overall direction of prices. A trader who went long during such a period comes to sincerely believe in their own analytical gift, without recognizing that an entirely random set of entries, synchronized with the prevailing move, would have produced an almost identical result. People systematically mistake the tailwind of a favorable trend for competence.
The problem with the availability heuristic is that human memory is structured not as an impartial database but as an associative network, in which recent and emotionally vivid events receive weight out of all proportion to their actual statistical relevance. Five winning trades in a row feel like compelling evidence of a working system, even though, from the standpoint of mathematical statistics, this is a vanishingly small sample that supports no well-founded conclusions about the effectiveness of the approach. A genuine evaluation of a strategy demands analysis of results over a far longer time horizon, taking into account drawdown metrics, the distribution of losing streaks, and robustness across different market regimes—in other words, it demands precisely the cold statistical thinking that the availability heuristic methodically supplants with an emotionally charged impression of recent experience.
Underestimating Nonlinearity: Linear Thinking in a Nonlinear WorldThe fifth fundamental error stems from the fact that human thinking is innately predisposed toward linear models of cause and effect: if factor A changes slightly, then outcome B should change proportionally and predictably. The financial market categorically refuses to submit to this intuitively comfortable logic. It is a complex adaptive system, one in which small changes in conditions can produce disproportionately large consequences, and in which familiar patterns abruptly break down under the pressure of threshold effects.
The retail trader, schooled on simplified heuristics such as "if the indicator is below a certain level, a rise must be coming soon," sees this model painfully refuted by reality time and again. When liquidity collapses abruptly, classic support levels that have served for years as reliable reference points can suddenly become zones of accelerated, cascading decline—because the sheer accumulation of limit orders resting at those levels, once taken out, amplifies the downward momentum rather than halting it. An "oversold" condition, which under a linear model ought to resolve quickly into a rebound, can persist for weeks and sometimes even months, in complete disregard of the expectations of those who think in terms of simple proportionality.
The market's nonlinearity also manifests in the phenomenon of volatility clustering: periods of calm tend to give way to periods of turbulence not gradually but abruptly, and the timing of that transition is fundamentally unpredictable within the framework of simplified linear models. The trader accustomed to extrapolating the recent past onto the near future is systematically caught off guard at the very moments of structural shifts in market regime—that is, exactly when the cost of error is greatest.
The Myth of Control and the Illusion of Simplicity: The Final TrapThe sixth and final trap combines several interrelated misconceptions that together produce the most dangerous distortion of all—an overestimation of one's own ability to control the uncontrollable. The retail trader, armed with a mobile app and a dozen indicator-laden charts, continues to believe that they can "outplay" a market whose price formation has long been dominated by algorithmic systems that process information at speeds and on scales beyond the reach of human perception. This situation contains a paradox: the greater a trader's subjective confidence in their own superiority over the market, the faster their capital flows to those participants who have delegated decision-making to a strict mathematical discipline free of emotional fluctuation.
The illusion of control is closely intertwined with another widespread misconception—the belief that making one's analysis more complex automatically increases the probability of success. Charts cluttered with dozens of overlapping indicators create no more than the appearance of a deep understanding of what is happening, and that appearance has nothing to do with genuine predictive power. The market does not reward the complexity of the analysis itself—it rewards the statistical significance of the decisions taken, discipline in position management, and the ability to filter out noise, separating it from the rare signals that are genuinely informative.
The participants who survive in this market over the long run are not those who sincerely believe they possess some secret knowledge or unique instinct denied to everyone else, but those who have accepted a basic and psychologically uncomfortable fact: the market is not an adversary to be outwitted by force of intellect or intuition, but a continuous stream of data in which the only truly hard currency is cold, impartial statistical regularity. Acknowledging one's own cognitive vulnerability is not a sign of weakness but the first and absolutely indispensable step toward a disciplined, systematic engagement with a market that ruthlessly punishes every illusion of control and rewards only sober, empirically validated calculation.
Chapter 3: Vulnerabilities of Algorithmic SystemsAn algorithm does not tire, does not panic, and does not succumb to the temptation to recoup losses after a series of drawdowns. This dispassion breeds a dangerous illusion of invulnerability—as though, having shed human psychology, a trading system also sheds the risk of error. In practice, the opposite occurs: weaknesses simply change form. Where a human errs out of fear, an algorithm errs out of rigidity of construction. Where a trader panics at the sight of a red candle, the machine continues methodically executing commands that have already lost touch with market reality. The vulnerabilities of algorithmic trading are no less dangerous than human ones: they are simply buried deeper, in the very architecture of the system, and they do not surface immediately but at the moment when the market changes the rules of the game without warning.
Overfitting: The Trap of Perfect HistoryThe first and, perhaps, most insidious vulnerability is overfitting—a state in which an algorithm ceases to search for patterns and begins instead to memorize specific historical episodes. The difference between learning and memorization seems abstract until you run into it with real capital at stake. A model optimized over a sufficiently long historical series with enough free parameters is capable of reproducing virtually any return on that very series. The difficulty is that such precision is not a sign of understanding the market, but a sign of fitting to noise.
The mechanism of overfitting can be compared to a portrait painter handed a single photograph and asked to produce an exact copy—a task that can be executed to perfection. But if the same painter is asked to draw a person from memory, relying on general facial features, the result will be far less precise, though considerably more universal. Algorithms overloaded with filters, additional conditions, and pinpoint exceptions "for that particular situation in March of such-and-such year" turn into portrait painters of the first type. They render the past beautifully and stand utterly helpless before the future, which will inevitably turn out to be a different person.
Multilayered optimization is particularly dangerous: a developer dissatisfied with the results begins tacking on conditions one after another until the historical return curve becomes perfectly smooth. Each such condition is, in essence, a bargain struck with the past rather than with the future. The system starts responding not to structural market patterns but to random coincidences that are statistically inevitable in any sufficiently long data series. The more degrees of freedom a model has, the higher the probability that it will stumble on a false pattern and mistake it for a true one. This is a fundamental problem rooted in the very nature of statistics: given enough attempts, randomness begins to look like system.
Telling overfitting apart from a genuine pattern is extraordinarily difficult specifically because the two are outwardly indistinguishable—until the market supplies a new data sample on which the illusory pattern falls apart. The robustness of a strategy is tested not by the beauty of its historical equity curve, but by whether it remains functional when parameters are shifted, when the instrument is changed, when it is transposed onto a neighboring time period. If the slightest change in conditions collapses the entire logic of the system, that is a sure sign that what we are looking at is not a trading strategy at all, but a skillfully painted portrait of the past.
Dependence on Liquidity as a Hidden FoundationThe second fundamental vulnerability lies deeper than the logic of the algorithm itself—it is concealed in an assumption that is rarely stated explicitly, yet underlies nearly every model: the market possesses sufficient liquidity to execute the algorithm's decision at the calculated price. This assumption holds in ninety percent of cases and fails catastrophically at the very moment when the cost of that failure is highest.
Liquidity is not a static parameter but a living substance that appears and disappears depending on the time of day, the macroeconomic backdrop, the actions of major market participants, and even technical failures at exchanges. An algorithm calibrated to average trading-session volumes perceives order book depth as a given, never questioning it until it suddenly evaporates. At that moment, a model calculating position size from historical slippage volatility discovers that actual slippage exceeds the built-in assumptions by orders of magnitude.
This vulnerability manifests with particular drama when liquidity collapses simultaneously across several correlated instruments. An algorithm conceived as a diversified portfolio of independent positions suddenly confronts the fact that correlation between assets shoots toward unity precisely when diversification is needed most. The reason is straightforward: in moments of panic, market makers withdraw capital from all risky instruments at once, leaving behind not a market with two sides but a vacuum in which price moves in jumps rather than along a smooth gradient.
A subtler form of this vulnerability also exists: dependence on liquidity artificially created by the algorithms themselves. A significant share of the visible order book depth in today's markets is supplied by high-frequency market makers whose quotes exist for mere fractions of a second and vanish at the slightest sign of an information shock. A strategy backtested on data that includes this phantom liquidity will systematically overestimate its ability to execute trades at calculated prices. In reality, the moment an algorithm attempts to unwind a large position during a stress event, all that visible liquidity dissolves instantly, leaving the order to collide with an empty book.
Temporal Lags as a Built-In Delay from RealityThe third vulnerability is rooted in the very physics of information: any data on which an algorithm relies is already the past by the moment a decision is made. The difference between the actual market and the market as the system perceives it is measured in temporal lags—from microsecond delays in quote transmission to far more serious lags in the calculation of derivative indicators.
Oscillators and most classical indicators are calculated on the basis of completed periods—a candle must close before the indicator updates. This means that the signal generated by the indicator is by its nature a lagging reflection of movement that has already occurred, not a foresight of the future. Under conditions of a smooth trend with moderate volatility, this lag is not critical—the tendency persists long enough that the delayed signal still proves useful. But at moments of sharp structural shifts, when price has no continuation and reverses almost instantaneously, the temporal lag becomes a direct source of losses: the algorithm receives a signal to act at the very moment when the movement that generated it has already run its course.
An even more dangerous form of temporal lag is connected to infrastructure delays: the time it takes for data to travel between the exchange, the broker, and the trading terminal. On highly liquid traditional markets, these delays are measured in milliseconds and rarely become critical for strategies operating on medium and long timeframes. But on markets with variable transaction processing speeds—for instance, where confirmation of an operation depends on network load—the delay can stretch to seconds or even minutes. In such moments, the algorithm acts blind, guided by a quote that has long since gone stale, while execution occurs at a completely different price. A cascading trigger of protective orders in such a situation can create a domino effect, in which one delayed signal provokes a series of subsequent ones, amplifying the original movement many times over.
Temporal lags cannot be eliminated entirely—only minimized. Even a theoretically ideal system capable of processing data instantaneously still faces the physical time required for signal transmission. The only reasonable response to this vulnerability is not to fight the lag but to acknowledge it and build it into the very architecture of risk management: the system must reserve a buffer for the possible divergence between the calculated and the actual execution price, especially during periods of elevated volatility, when price is capable of traveling a significant distance in precisely the time it takes the signal to reach the point of execution.
Emergent Behavior: When Multiple Algorithms Create a New RealityThe fourth vulnerability is fundamentally different in character—it arises not from the properties of any single system, but from the collective interaction of many independently operating algorithms. Each developer, in building their model, proceeds from the assumption that the market is an external environment upon which their algorithm exerts negligible influence. This assumption holds true for a solitary participant with modest capital, but becomes false at scale, when hundreds and thousands of algorithms trained on similar data and employing similar logic begin responding to the same triggers in near-simultaneous fashion.
Emergent behavior in this context is the appearance of qualitatively new system behavior that cannot be directly derived from the properties of its individual components. A single algorithm responding to a breakout of a key level with a buy order behaves entirely rationally within its own logic. But when thousands of such algorithms respond to that same breakout simultaneously, their collective action creates a positive feedback loop: purchases by one set of systems push the price upward, which triggers the exact same signals in neighboring systems, which pushes the price higher still, drawing the attention of ever more algorithms. The result is a price movement devoid of fundamental cause, generated entirely by structural resonance among homogeneous trading logics.
What is most troubling about this phenomenon is its self-reinforcing nature exactly where algorithms are most technically sophisticated. The more precisely models adhere to the same widely accepted principles of technical analysis, the more standardized their thresholds and trigger levels, the stronger the resonance effect becomes. Paradoxically, reducing the individual error of each separate model increases systemic risk across the entire ecosystem, because it unifies participant behavior. Diversity of approaches, which appears to be a shortcoming from the perspective of an individual developer striving for the perfect model, turns out to be a protective mechanism for the system as a whole—it distributes reactions across time and reduces the probability of synchronized triggering.



