AI FX Bot Lab: Real Trading Experiments

Kimi | Japan FX Bot Lab

Can AI really trade forex? AI FX Bot Lab is a real-time experiment from Japan, where I build and test AI-assisted FX trading bots using MT5, Python, machine learning, and local LLM tools. I share live results, failures, risk lessons, and bot improvements from rule-based, AI-driven, and ML + LLM hybrid systems. Not financial advice. fxaibotlab.substack.com

  1. 12h ago

    The Exit Layer Won: Five MT5 Bots Closed at +¥624

    Conclusion The five-bot portfolio finished the session with a realized gain of ¥624. Three bots were positive, one did not trade, and LLMBridgeTrader closed four positions without a single win. The -¥195 stop on its first trade made me pause. The later losses shrank to -¥80, -¥16, and -¥5, so the bot did become quicker about getting out, but it never found a profitable exit during the reporting window. That makes this less of an entry contest and more of a test of when each system gives up on its original idea. MAribbonTrader also needs a closer look despite ending positive. Its +¥316 closing trade appears to have come from a position carried into the day, and the three positions opened and closed on July 27 produced a combined -¥89 before swap. The account made money, but the fresh setups did not. Win rate below includes the zero-yen GateGrid AI closure in the total number of closed trades. Gross profit, gross loss, and payoff ratio exclude swap. Bot-by-bot results ■ GateGrid AI +384 yen Market: EURUSD- Record: 5W / 0L / 1 flat Win rate: 83.3% Gross profit: +384 yen Gross loss: 0 yen Payoff ratio: N/A, no losing trade Max loss: 0 yen ■ BoundSniper Bot 0 yen Trades: None reported Record: N/A Win rate: N/A Gross profit: 0 yen Gross loss: 0 yen Payoff ratio: N/A Max loss: N/A ■ LLMBridgeTrader -296 yen Market: EURUSD- Record: 0W / 4L Win rate: 0.0% Gross profit: 0 yen Gross loss: -296 yen Payoff ratio: N/A, no winning trade Max loss: -195 yen Unrealized P/L at cutoff: -16 yen ■ ML_ScoreAnalyst +300 yen Market: GBPJPY- Record: 1W / 0L Win rate: 100.0% Gross profit: +300 yen Gross loss: 0 yen Payoff ratio: N/A, no losing trade Max loss: 0 yen ■ MAribbonTrader +236 yen Market: GBPCAD- Record: 2W / 2L Win rate: 50.0% Gross profit: +505 yen Gross loss: -278 yen Payoff ratio: 1.82 Max loss: -154 yen Swap: +9 yen ■ Total +624 yen Record: 8W / 6L / 1 flat Win rate: 53.3% Gross profit: +1,189 yen Gross loss: -574 yen Payoff ratio: 1.55 Max loss: -195 yen Swap: +9 yen Unrealized P/L at cutoff: -16 yen Today’s theme: the MT5 report knows what happened, but not why The execution report gives a clear sequence of entries, exits, stops, and take-profits. What it does not contain is the model context behind those actions: confidence, setup type, HOLD or CLOSE reasoning, chart state, or the inputs shown to the LLM. That gap matters most for LLMBridgeTrader. Its design allows the model to choose OPEN, HOLD, CLOSE, and REVERSE while also proposing SL and TP distances. Looking only at the MT5 result, I cannot tell whether the -¥80 market exit was a sensible early escape from a broken setup or a late reaction after the model ignored an earlier warning. The same issue exists in MAribbonTrader. The trading report shows the outcome, but not whether Qwen saw a first pullback to the long-term ribbon, a resistance retest, a narrowing channel, or a reason to switch from HOLD to EXIT. Without that join, a winning trade can look smarter than it was, and a losing trade can look worse than the decision that produced it. GateGrid AI GateGrid AI had the cleanest realized record of the day. It closed six short positions for five gains and one flat result, with no losing exit and no open exposure at the cutoff. The closures came in groups. Two positions were closed around 14:30 for +¥92 and ¥0, while another pair was closed around 16:58 for +¥110 and +¥21. That looks like basket-level management rather than demanding that every grid layer reach an individual target, and it worked well in this session. There is one configuration detail worth checking. The bot overview describes GateGrid AI as a GBPUSD system, but this live report records EURUSD- orders. The analysis here follows the actual account report, though the symbol difference should be confirmed before comparing the result with model thresholds or training data. A payoff ratio cannot be calculated because there was no losing trade. That is a pleasant problem for one day, but six closures are not enough to judge the grid’s real downside. Its max-loss behavior remains untested in this sample. BoundSniper Bot No BoundSniper transaction details were included, so it is recorded as no trade. For a bridge bot, inactivity is not automatically a problem; it may simply mean TradingView sent no qualifying signal. Still, its logs should distinguish between “no alert received,” “alert rejected,” and “order submission failed.” All three create an empty MT5 report, but they describe very different system states. LLMBridgeTrader LLMBridgeTrader was the weak point of the portfolio. Four completed EURUSD- trades lost -¥195, -¥80, -¥16, and -¥5, producing a 0% win rate and the day’s largest single loss. The sequence is not entirely negative from a risk perspective. After the first stop, each completed loss became smaller, which may indicate that later CLOSE decisions reacted faster. I would not claim that from execution data alone, though; the market may simply have moved less. The first buy was closed by a stop at -¥195. Two later buys were closed at market for -¥80 and -¥16, followed by a sell closed at -¥5. A new short was then opened at 23:00 and remained open with -¥16 of unrealized loss at the report cutoff. For a bot with broad LLM discretion, the next useful comparison is not just BUY versus SELL accuracy. Each losing trade should be joined to the model’s confidence, setup label, original SL and TP proposal, every HOLD decision, and the final reason for CLOSE. The exit model is where the evidence is missing. ML_ScoreAnalyst ML_ScoreAnalyst took one GBPJPY- short and reached its take-profit for +¥300. It was a simple result: one scored entry, one predefined target, and no further exposure. The fixed exit beat the adaptive LLM exits today, but the sample size is one. I would not promote the score threshold or TP setting on this result alone. What it does provide is a useful control case for the more flexible bots: a narrow decision system can be easier to evaluate because the path from signal to result is short. MAribbonTrader MAribbonTrader recorded two wins and two losses, with a payoff ratio of 1.82. That is the strongest measurable payoff ratio among the five bots, since the other profitable systems had no losing trades from which to calculate one. The +¥316 close appears without a corresponding same-day entry and also earned +¥9 in swap, so it was probably a position carried into July 27. After that, the bot closed a fresh long for +¥189, then lost -¥154 and -¥124 on two more longs. Those three same-day round trips netted -¥89. This split matters. The account-level result was +¥236, but the new setups had a difficult day. The -¥154 stop caught my eye because it arrived shortly after the profitable TP, followed almost immediately by another entry and another stop. That may be a re-entry filter problem, a ribbon-state problem, or just a bad patch of GBPCAD movement. The MT5 report cannot settle it. The MAribbon logs should make it possible to check whether the two losing entries shared the same chart context. I would look first at long-term ribbon direction, distance to resistance, whether the move was still an impulse or already a correction, and why the second long was allowed only about ninety seconds after the previous stop. Summary The portfolio’s realized result was positive, but the most useful output from the day is not the ¥624. It is the contrast between systems whose exits were explicit and systems whose exits depended on changing model judgment. The next improvement may not be a new prompt or another indicator. A shared trade ID connecting every LLM response, chart snapshot, position action, and MT5 execution would make the losses far more valuable. Right now the numbers are clear, while the decisions that created them are still partly hidden. This is a public episode. If you'd like to discuss this with other subscribers or get access to bonus episodes, visit fxaibotlab.substack.com/subscribe

    The Exit Layer Won: Five MT5 Bots Closed at +¥624
  2. 3d ago

    Winning 57% Wasn’t Enough: GateGrid’s Exit Math Sank the Five-Bot Day

    The conclusion July 24 was not mainly an entry problem. It was an exit problem. The five-bot portfolio ended the day at -¥461 in realized P/L. GateGrid AI won four of its seven closed trades, giving it a 57.1% win rate, but the payoff ratio was only 0.28. Its winners averaged ¥53, while its losers averaged about ¥189. The final -¥296 loss made me stop for a moment; several small wins had done almost nothing to prepare the account for that exit. LLMBridgeTrader also finished negative, but its loss structure looked different. It lost two of three closed trades, yet its payoff ratio was 0.96 and the final loss was cut at just -¥11. That does not make the day good, but it suggests that the position-management layer was at least willing to abandon a weak idea. BoundSniper Bot and ML_ScoreAnalyst recorded no closed trades. MAribbonTrader opened one GBPCAD position, which remained open with an unrealized loss of ¥17 at the report cutoff. Bot-by-bot results ■ GateGrid AI -356 yenRecord: 4W / 3LWin rate: 57.1%Gross profit: +212 yenGross loss: -568 yenPayoff ratio: 0.28Max loss: -296 yen ■ LLMBridgeTrader -105 yenRecord: 1W / 2LWin rate: 33.3%Gross profit: +97 yenGross loss: -202 yenPayoff ratio: 0.96Max loss: -191 yenSwap included: +6 yen ■ BoundSniper Bot 0 yenRecord: 0W / 0LWin rate: N/AGross profit: 0 yenGross loss: 0 yenPayoff ratio: N/AMax loss: 0 yen ■ ML_ScoreAnalyst 0 yenRecord: 0W / 0LWin rate: N/AGross profit: 0 yenGross loss: 0 yenPayoff ratio: N/AMax loss: 0 yen ■ MAribbonTrader 0 yenRecord: 0W / 0LWin rate: N/AGross profit: 0 yenGross loss: 0 yenPayoff ratio: N/AMax realized loss: 0 yenOpen positions: 1Unrealized P/L: -17 yen ■ Total -461 yenRecord: 5W / 5LWin rate: 50.0%Gross profit: +309 yenGross loss: -770 yenPayoff ratio: 0.40Max loss: -296 yenUnrealized P/L excluded: -17 yen Today’s theme: the model can choose an entry, but the exit decides the damage These five bots do not make decisions in the same way. BoundSniper Bot does not predict the market at all. It receives TradingView signals through a webhook and delivers them to MT5. ML_ScoreAnalyst uses a CatBoost score to filter GBPJPY breakout candidates. GateGrid AI is designed as a multi-stage system, using a quantitative gate before asking a local LLM to evaluate volatility, trend, session conditions and grid settings. LLMBridgeTrader gives the AI more freedom. It can propose BUY, SELL or NONE, but it can also choose OPEN, HOLD, CLOSE or REVERSE. It produces confidence, setup type, stop distance, profit target and reasons for entering or exiting. MAribbonTrader goes further into discretionary territory by asking Qwen to read a chart image containing moving-average ribbons, higher-timeframe context, support and resistance, range boxes and channel information. That makes the exit question especially important. An LLM can produce a convincing reason to remain in a position. It can also produce a convincing reason to close it. Only the realized trade tells us whether that flexibility protected the account or merely delayed the loss. The broker statement gives us the actions and outcomes, but not the bots’ internal decision logs. We can see when a position was opened and closed, yet we cannot verify the confidence score, setup classification or written exit reason that led to each action. That missing link matters. The next review should compare the model’s stated reason with the eventual P/L, rather than judging the model only from the broker report. GateGrid AI: the win rate hid an expensive loss structure GateGrid AI closed seven trades on EURUSD during the day. The design memo describes the bot as a GBPUSD system, so either the live configuration has changed or the running instance differs from the documented setup. It is worth recording that configuration change because symbol selection can alter volatility, spread and grid behavior. The first closed position lost ¥67. Two later long positions produced gains of ¥102 and ¥7. Another pair of short positions returned ¥98 and ¥5. At that stage, the sequence probably felt under control. The final two shorts changed the entire result. They were closed together for losses of ¥205 and ¥296. This is the weak point in the day’s result. Four winning trades produced only ¥212 in total, while three losing trades removed ¥568. The bot did not need a higher win rate. It needed either smaller losing exits or more room for the profitable layers to run. GateGrid uses filters before entry, including CatBoost probabilities, session thresholds, ATR conditions and a local Ollama judgment. Those filters may have done their job by selecting several trades that moved in the expected direction. The account still lost because the exit distribution was asymmetric in the wrong direction. The most useful log review is not simply “Why did the bot sell?” It is “Why were the last two positions still being held when their combined loss passed the total value of all four winners?” The answer is probably in the grid-closing or continuation logic, though the broker statement alone cannot prove it. LLMBridgeTrader: a losing day, but a more balanced exit profile LLMBridgeTrader closed three positions for a net realized result of -¥105. The first was a carried position that closed for -¥197 in trading P/L, partly offset by +¥6 in swap. The net loss was therefore ¥191. A new short was then opened at 10:30 and closed eight minutes later for a ¥97 gain. In the afternoon, a long position was opened and abandoned about fourteen minutes later for an ¥11 loss. That last exit is small, but it matters. I saw the -¥11 and thought this is at least the kind of failed idea the account can absorb. The bot’s win rate was only 33.3%, yet its payoff ratio reached 0.96. Average profit and average loss were nearly balanced, unlike GateGrid’s 0.28 ratio. The larger carried loss still dominated the day, but the newer intraday decisions did not show the same pattern of taking tiny gains while tolerating oversized losses. Because LLMBridgeTrader can return HOLD, CLOSE or REVERSE, its quality cannot be measured only at entry. The model must recognize when the original premise has weakened and switch from explanation mode to exit mode. The quick closure of the final long suggests that this transition happened, although the internal reason log is needed before calling it a repeatable improvement. The question for this bot is not whether the AI can describe a good setup. It is whether its confidence falls quickly enough when reality stops matching that description. BoundSniper Bot: no result to judge BoundSniper Bot recorded no closed trades in the supplied report. That is not automatically a weakness. This bot is an execution bridge rather than a market forecaster. Its performance depends on whether TradingView produced a signal and whether the webhook, tunnel and MT5 execution chain delivered it correctly. With no trades, there is no payoff ratio or exit behavior to evaluate. The useful checks are operational: whether alerts were generated, whether webhook events arrived, whether any orders were rejected and whether the absence of trades was intentional. ML_ScoreAnalyst: the filter stayed inactive ML_ScoreAnalyst also recorded no trades. The system uses CatBoost to score GBPJPY breakout candidates and enters only when the score exceeds its threshold. A no-trade day may mean that no valid candidate appeared, or that candidates remained below the entry threshold. The broker statement cannot distinguish between those possibilities. The score log should show whether the bot spent the day returning NONE or actively rejecting low-scoring setups. Both lead to zero trades, but they say different things about the model. MAribbonTrader: the exit test is still open MAribbonTrader opened one 0.01-lot GBPCAD buy at 1.87744. At the report cutoff, the market price was 1.87729 and the position showed an unrealized loss of ¥17. The trade had a stop at 1.87433 and a target at 1.88175. It had not reached either level, so there is no closed result to score. Its realized P/L remains zero. This is the bot where the exit question may be most revealing. Qwen is being asked to interpret moving-average ribbons, higher-timeframe context, support and resistance, range conditions and channel structure. A chart-reading model can decide that a setup remains visually valid even while the position drifts against it. The next log should show whether the model continues to return HOLD, switches to EXIT before the stop, or lets the original risk plan play out. None of those choices is automatically correct. The value lies in whether the decision is consistent with the reason given at entry. Closing thoughts A 50% portfolio win rate sounds neutral. A 0.40 payoff ratio is not neutral. July 24 showed how easily a few modest winners can create the feeling that a system is working while one exit sequence does most of the financial damage. GateGrid’s filters may have selected acceptable entries, and LLMBridge may have produced sensible short-term reactions, but the account was still governed by the size of the losing exits. The next improvement should not be another entry filter added on top of the existing ones. I would first connect every CLOSE, HOLD and forced stop to the model’s recorded reason. A bot that can explain why it entered is interesting. A bot that notices when its own explanation has expired is useful. This is a public episode. If you'd like to discuss this with other subscribers or get access to bonus episodes, visit fxaibotlab.substack.com/subscribe

    Winning 57% Wasn’t Enough: GateGrid’s Exit Math Sank the Five-Bot Day
  3. 4d ago

    Stops That Paid: Two AI Bots Banked ¥599 and Carried the Five-Bot Run

    Conclusion July 23 ended with a realized profit of ¥574 across the five-bot lineup. Only three bots had closed trades in the supplied account statements, but two of them did enough: LLMBridgeTrader earned ¥398 and MAribbonTrader added ¥201, while GateGrid AI finished slightly negative at ¥25. What caught my attention was not just the total. Several exits marked as stop-loss orders still closed in profit. That suggests the protective exit layer was doing more than limiting damage; it was also preserving gains after the market had already moved in the bot’s favor. LLMBridgeTrader still held one EURUSD- short position at the end of the report with an unrealized loss of ¥38. That floating result is not included in the ¥574 realized total. Bot Performance ■ LLMBridgeTrader +398 yenRecord: 4W / 1LWin rate: 80.0%Gross profit: +644 yenGross loss: -246 yenPayoff ratio: 0.65Max loss: -246 yen ■ MAribbonTrader +201 yenRecord: 2W / 0LWin rate: 100.0%Gross profit: +201 yenGross loss: 0 yenPayoff ratio: N/AMax loss: 0 yen ■ GateGrid AI -25 yenRecord: 8W / 3LWin rate: 72.7%Gross profit: +358 yenGross loss: -383 yenPayoff ratio: 0.35Max loss: -197 yen ■ BoundSniper Bot ±0 yenRecord: 0W / 0LWin rate: N/AGross profit: 0 yenGross loss: 0 yenPayoff ratio: N/AMax loss: N/A ■ ML_ScoreAnalyst ±0 yenRecord: 0W / 0LWin rate: N/AGross profit: 0 yenGross loss: 0 yenPayoff ratio: N/AMax loss: N/A ■ Total +574 yenRecord: 14W / 4LWin rate: 77.8%Gross profit: +1,203 yenGross loss: -629 yenPayoff ratio: 0.55Max loss: -246 yen Today’s Theme: A Stop Is Not Always a Losing Exit The account statement contains a useful detail. Four profitable LLMBridgeTrader exits were recorded with stop-related comments, and MAribbonTrader also closed its second trade through a stop-tagged order while still banking ¥41. That ¥41 exit looked modest, but I liked it. A stop that closes above the original entry is no longer just an emergency brake. It becomes a mechanism for turning open profit into realized profit before the market has time to take it back. The exact model reasoning is not included in the broker statement, so I cannot tell whether each stop adjustment came directly from the LLM, a trailing rule, or another risk-management layer. The execution result is clear, though: the profitable bots were able to leave the market with money still on the table. LLMBridgeTrader: Four Winning Exits Absorbed One Full Loss LLMBridgeTrader produced five completed EURUSD- trades: +¥261, +¥88, +¥131, -¥246, and +¥164. Seeing +¥398 from only five closed positions was the first number that made me pause. The bot’s design gives the AI a wide decision space. It can propose BUY, SELL, or NONE, select OPEN, HOLD, CLOSE, or REVERSE, and return confidence, setup type, stop distance, target distance, and reasons for entry or exit. Risk checks then decide whether that plan is acceptable. The day was not flawless. Its single ¥246 loss was also the largest loss across all five bots, and the payoff ratio was only 0.65. The average winning trade was smaller than the losing trade, so the result depended on maintaining a high hit rate. Still, the sequence recovered well. Three early winners built ¥480, the loss removed ¥246, and the following ¥164 winner restored the daily result to ¥398. The exit process did not freeze after taking a hit, which matters for a system allowed to reassess positions through an LLM. MAribbonTrader: Two Shorts, Two Profitable Closures MAribbonTrader completed two GBPCAD- short trades and won both. The first reached a take-profit exit for ¥160, while the second closed through a stop-tagged order for another ¥41. This bot gives Qwen a chart image containing the short- and long-term MA ribbons, higher-timeframe context, support and resistance areas, range boxes, crossings, and channel information. The model then returns WAIT, BUY, SELL, or EXIT together with its reasoning. Two trades are far too few to prove an edge, and the payoff ratio cannot be calculated because there were no losing trades. Even so, this is the kind of small sample I would rather see: limited activity, no forced entry, and profit retained on both positions. The second trade is the more interesting one for the experiment. It did not need to reach its original target to contribute. The exit layer found a way to close positively, although the broker report alone does not reveal whether that came from the visual model’s judgment or a mechanical stop update. GateGrid AI: Gross Profit Was There, but the Exit Leakage Was Larger GateGrid AI won eight of eleven closed trades and generated ¥358 in gross profit. On win rate alone, the day looked healthy. The problem was that three losses totaled ¥383, leaving the bot down ¥25. The ¥197 loss was the one that bothered me. With an average win of only ¥44.75 and an average loss of roughly ¥127.67, the payoff ratio fell to 0.35. The bot needed almost three average winners to recover one average loss. Before the last two exits, GateGrid AI was ahead by ¥161. The final two closures lost ¥43 and ¥143, removing ¥186 and turning a profitable session into a small negative one. Its entry filters found enough favorable movement to create real gross profit, but the closing sequence gave slightly more back. GateGrid AI uses CatBoost as a quantitative gate before passing selected situations to Ollama. The local LLM then considers items such as spread, ATR, higher-timeframe trends, session, grid width, and recent performance. The broker statement does not contain the AI_SKIP, OLLAMA_HOLD, or decision-reason logs, so this report can evaluate the trade outcomes but not the exact rationale behind each entry. There is also a logging detail worth checking. The system description identifies GateGrid AI as a GBPUSD strategy, while the supplied account statement shows EURUSD-. For this article, I have followed the live account statement. BoundSniper Bot and ML_ScoreAnalyst No closed trades from BoundSniper Bot or ML_ScoreAnalyst appeared in the supplied statements. I have therefore recorded both as flat for this daily comparison rather than assuming anything about their broader operational status. BoundSniper is primarily an execution bridge. It carries TradingView signals through a webhook and local server into MT5, so its value is measured not only by strategy profit but also by execution accuracy, logging, and the absence of missed or duplicated orders. ML_ScoreAnalyst uses a CatBoost score to filter GBPJPY breakout candidates. Since there were no trades to evaluate, the useful evidence for this day would be its skipped signals and score distribution, but those logs were not included in the account report. Summary The profitable side of July 23 came from two different AI designs. LLMBridgeTrader used a broad trade-planning framework and recovered after one large loss, while MAribbonTrader took only two positions and kept both positive. GateGrid AI also found profitable moves, but its gross profit did not survive the full exit sequence. That contrast is useful. Entry quality created the opportunity, but the bots that finished ahead were the ones that converted open movement into closed profit. The next step is to connect each broker-side exit with its model output, confidence, decision reason, and stop update history. I do not just want to know which bot made money. I want to know whether the way it kept that money can be reproduced. This is a public episode. If you'd like to discuss this with other subscribers or get access to bonus episodes, visit fxaibotlab.substack.com/subscribe

    Stops That Paid: Two AI Bots Banked ¥599 and Carried the Five-Bot Run
  4. 5d ago

    Four Wins, Two Losses, Still Down: The Exit Math Beat the Hit Rate

    The five-bot run finished at **-221 yen**, even though the closed trades produced four wins and only two losses. The combined win rate was 66.7%, but the payoff ratio was just 0.27. That gap tells the story better than the hit rate does. GateGrid AI posted the largest loss at -351 yen. MAribbonTrader won two of its three trades, yet one -125 yen stop erased the +101 yen collected from the first two. LLMBridgeTrader showed the opposite pattern: its EURUSD short was closed through a stop mechanism after moving into profit, leaving +130 yen behind. The entries mattered, but the day was decided by how each bot stopped holding. Bot-by-Bot Results ■ GateGrid AI -351 yen Record: 0W / 1L Win rate: 0.0% Gross profit: 0 yen Gross loss: -351 yen Payoff ratio: N/A Max loss: -351 yen ■ BoundSniper Bot +24 yen Record: 1W / 0L Win rate: 100.0% Gross profit: +24 yen Gross loss: 0 yen Payoff ratio: N/A Max loss: 0 yen ■ LLMBridgeTrader +130 yen Record: 1W / 0L Win rate: 100.0% Gross profit: +130 yen Gross loss: 0 yen Payoff ratio: N/A Max loss: 0 yen ■ ML_ScoreAnalyst 0 yen Record: 0W / 0L Win rate: N/A Gross profit: 0 yen Gross loss: 0 yen Payoff ratio: N/A Max loss: 0 yen Note: No daily trade report was supplied. ■ MAribbonTrader -24 yen Record: 2W / 1L Win rate: 66.7% Gross profit: +101 yen Gross loss: -125 yen Payoff ratio: 0.40 Max loss: -125 yen ■ Total -221 yen Record: 4W / 2L Win rate: 66.7% Gross profit: +255 yen Gross loss: -476 yen Payoff ratio: 0.27 Max loss: -351 yen ## Today’s Theme: The Moment a Bot Stops Holding A win rate can describe how often a decision worked, but it cannot explain how much damage was done when it failed. July 22 made that distinction hard to ignore. Four winning trades averaged 63.75 yen, while the two losses averaged 238 yen. For the LLM-driven bots, the interesting question is not only whether the model selected the correct direction. It is whether the bot knew when the original idea had weakened enough to close, trail, or reverse. An entry model can be slightly wrong and survive. An exit process that stays passive for too long can turn one mistake into the entire day’s result. GateGrid AI GateGrid AI opened an EURUSD short at 1.13997 and closed it at 1.14212 roughly twelve hours later. The result was -351 yen, the largest single loss of the day. I paused at that number because it outweighed every profitable trade from the other bots combined. The design notes describe GateGrid AI as a multi-stage system using CatBoost, local LLM judgment, volatility checks, time filters, and trailing management. The daily broker report alone does not reveal which gate approved this entry or why the position remained open. It also shows EURUSD, while the intended configuration describes GBPUSD, so the live symbol setting deserves a separate check. The immediate issue is the exit path. A filtered entry is useful only if the system can recognize when the approved setup is no longer valid. The next review should match the broker timestamps against the CatBoost score, Ollama response, ATR state, trailing-stop updates, and any hold decision recorded during the position. BoundSniper Bot BoundSniper entered a USDJPY long at 163.067 and closed it one minute later at 163.091 for +24 yen. It was a small trade, but the execution chain appears clean: the TradingView instruction reached MT5, the position opened, and the exit followed without a visible operational error. This bot does not predict the market itself, so its result should not be judged like an LLM strategy. Its job is faithful delivery. The useful questions are whether the correct signal was received, whether latency or spread altered the intended price, and whether the exit command was executed once without duplication. There is no meaningful payoff ratio from one winning trade and no losing sample. Still, the trade did what an execution bridge is supposed to do, which matters more than trying to turn +24 yen into a larger claim. LLMBridgeTrader LLMBridgeTrader sold EURUSD at 1.14172 and closed at 1.14092 for +130 yen. The closing comment indicates a stop-based exit, suggesting that the protection level had moved into profitable territory or was otherwise used to lock in the favorable move. This was the most convincing exit of the day. The bot did not need to catch the entire decline. It converted an open gain into a realized result and avoided letting the trade drift back through the entry. The report does not include the model’s confidence, setup label, original SL/TP proposal, or decision text, so it cannot prove whether the LLM itself initiated the final exit. Those logs matter. Still, the live outcome shows a useful separation between AI planning and mechanical protection: the model can propose the trade, while the system makes sure a favorable position does not remain unprotected. ML_ScoreAnalyst No July 22 trade report was included for ML_ScoreAnalyst. I have recorded it as zero closed trades rather than assuming that the bot was inactive. That distinction matters. A score-based bot may correctly skip an entire day because no candidate cleared its threshold, or it may simply have a missing report. The signal log is needed to tell whether the day consisted of valid SKIP decisions, no breakout candidates, a stopped process, or a reporting gap. For this bot, no-trade days are part of the experiment. They become informative only when the candidate score and rejection reason are retained. MAribbonTrader MAribbonTrader completed three GBPCAD shorts. The first two earned +38 yen and +63 yen. The third lost -125 yen, leaving the bot at -24 yen despite winning two of three trades. That loss felt familiar: two correct reads, then one trade large enough to take them both back. The payoff ratio was 0.40 because the average winner was 50.5 yen and the average loser was 125 yen. A 66.7% win rate looks comfortable until that ratio is placed beside it. The final trade was stopped about nine minutes after entry, so this was not a case of holding for hours without protection. The harder question is whether the initial risk was too large relative to the profit the bot usually accepts. If winners are routinely closed around 38 to 63 yen, a 125 yen loss requires an unusually high hit rate just to stay level. Because MAribbonTrader delegates chart interpretation and exit reasoning to AI, its SQLite logs should be used to compare the three trades. The review needs the ribbon state, H4 context, support and resistance, channel room, entry explanation, and exit explanation. The cause may be the stop width, or it may be that the third setup should have been rejected before entry. The broker statement cannot settle that yet. Summary The day did not expose a shortage of winning signals. It exposed an imbalance between what the bots were willing to take as profit and what they were willing to surrender when wrong. LLMBridgeTrader left the cleanest clue by protecting a profitable short. MAribbonTrader showed why a respectable hit rate can still leak money, while GateGrid AI showed how one unresolved position can dominate a multi-bot portfolio. The next improvement may not be another entry filter. It may be teaching each bot to notice sooner when staying in the trade has become the risk. This is a public episode. If you'd like to discuss this with other subscribers or get access to bonus episodes, visit fxaibotlab.substack.com/subscribe

    Four Wins, Two Losses, Still Down: The Exit Math Beat the Hit Rate
  5. 5d ago

    If You Keep Fixing the Strategy, You May Lose the Ability to Understand It

    The day after a loss, every strategy appears easy to improve. The stop was too wide. The entry was too early. The session was wrong. The filter was too weak. There is always something that could have prevented the latest losing trade. So we change it. The next trade loses too. We change something else. Eventually, the strategy has been modified so many times that we can no longer explain what improved or what failed. We wanted a better system. We removed the evidence needed to understand the original one. Change feels like progress Doing nothing during a drawdown feels irresponsible. The account is declining. The same rules are still running. The trader feels expected to act. So the stop is tightened. Another indicator is added. The trading window is reduced. A new market-regime filter is introduced. Editing the code provides immediate relief. The system looks more protected. At least something has been done. But emotional relief and strategy improvement are not the same thing. A change designed to reduce discomfort may not improve long-term performance. Losses do not arrive on schedule Strategy losses may be distributed over hundreds of trades in a test. Live trading does not deliver them evenly. Several losing trades may arrive together. Different bots may fail during the same market transition. What was expected to occur across several months can appear inside one week. Leverage makes this concentration feel even more significant. At small size, the week may look like ordinary variance. At larger size, it feels like structural failure. The market behavior is identical. The financial pain changes the diagnosis. A trader may believe the strategy is being evaluated objectively while actually reacting to the size of the drawdown. One adjustment creates another Suppose a losing streak leads to a tighter stop. The new stop is reached by ordinary price movement. Loss frequency increases. The trader responds by adding stricter entry filters. Trade frequency falls too far. The session is expanded to create more opportunities. The expanded session introduces different spreads and price behavior. Another filter becomes necessary. The first adjustment was small. Its consequences created a chain of additional adjustments. Later, performance improves. Was it the tighter stop? The entry filter? The wider session? Or did the market simply return to a more favorable regime? Nobody knows. The strategy was improved in several places and made impossible to evaluate in any one place. Preserve the baseline Testing requires a comparison. Before and after. The same market. The same costs. The same sizing. The same time horizon. When several variables change together, the comparison disappears. A useful process preserves the original version. Keep one bot on the old configuration. Store the previous parameters. Write one sentence explaining why each change was made. Define the number of trades or amount of time required before judging it. Record what the new rule removes, including the winning trades it may also remove. Improvement is not only the act of adding a better rule. It is also the discipline of protecting the evidence needed to verify that the rule is better. I feel the same urge with trading bots I run several MT5 bots built around different approaches. Some are rule based. Some receive TradingView alerts. Some use machine-learning scores. Some include language-model judgment. After a losing day, the code looks full of obvious improvements. A condition could have avoided this trade. An earlier exit could have protected that profit. A different filter could have rejected the setup. Looking backward makes the answer appear clear. But a rule designed to avoid one historical loss may remove profitable trades in another market. Avoiding a particular loss is not the same as improving the full distribution of outcomes. Without that distinction, a bot gradually becomes optimized for the chart that already happened. Diagnose before changing A negative P&L does not identify the broken component. The problem may be the entry. The direction was wrong, price was chased, or the setup did not fit the regime. It may be the exit. The stop was unsuitable, the strategy gave back profit, or it failed to respond to reversal evidence. It may be the size. The position was too large or several systems carried the same hidden exposure. It may be execution. Spread widened, orders were delayed, or retry logic behaved incorrectly. It may be the market environment. The strategy was designed for movement that was no longer present. The same financial result can come from different operational causes. Changing the full strategy before separating those causes often modifies the parts that were working. Reduce size before rewriting logic Maintaining the same rules during a losing period can still feel dangerous. A practical first response is to reduce size. This is not avoidance. It protects the ability to observe. At full exposure, each result carries more emotional force. Normal variance feels unacceptable. The need to recover becomes stronger. Parameter changes become more urgent. Smaller size reduces the financial pressure without immediately changing the system being evaluated. The strategy can continue producing evidence. Losses have less impact on the account. A favorable regime can return without the original logic having been removed. During a drawdown, the first goal is not always to find the answer immediately. It may be to preserve enough capital and mental space to recognize the answer later. Doing nothing still requires a plan “Do nothing” can become a dangerous excuse. A genuinely broken strategy can be allowed to continue under the label of patience. Observation needs boundaries. For example: Keep the logic unchanged for the next twenty trades. Run at half size. Record entry, exit, spread, session, and execution quality. Separate rule-following losses from operational failures. Stop if the drawdown exceeds a predefined limit. After the observation window, select only one modification to test. This is not passive neglect. It is a controlled period in which changes are delayed so that evidence can remain comparable. Useful improvements are often boring Strategy improvement is often associated with major additions. A new AI model. A new indicator. A new entry engine. A new market. In production, the most valuable changes may be less dramatic. Rejecting trades during excessive spread. Improving retry logic. Preventing duplicate exposure. Writing better logs. Defining restart conditions. Correcting position-size calculations. Each change is small. None creates a completely new strategy. Together, they remove repeated operational mistakes. A modest improvement that remains active for years may contribute more than a sophisticated idea that is replaced after the next drawdown. Activity is not evidence of improvement A large amount of work can be completed without making the strategy better. More code. More backtests. More parameters. More filters. The useful questions remain: What improved relative to the original? Did it improve in unseen periods? Does the result survive transaction costs? Which profitable trades were removed? Can the change be explained and repeated? Changing a strategy is easy. Keeping it unchanged long enough to learn from it is harder. That waiting period is not wasted time. It is what makes the next adjustment interpretable. The same pattern appears outside trading A newsletter fails to grow, so the topic changes. A product receives little attention, so new features are added. A study method feels slow, so another course is purchased. Changing the method produces a sense of movement. But when the method changes before results have enough time to appear, no learning accumulates. Improvement requires adjustment. It also requires periods of stability. Without stable periods, the effect of each adjustment remains invisible. Preserve before you repair There is no perfect trading strategy. Losses cannot be removed completely. Unexpected clusters will occur. Rebuilding the system after each one prevents the strategy from developing a reliable history. The answer is not to ignore poor results. It is to slow the rate of change when poor results create the strongest urge to act. Reduce size. Separate the causes. Keep the logs. Preserve the baseline. Change one variable. Wait long enough to observe the result. Before repairing the strategy, protect the process that allows you to learn what needs repair. Is the next adjustment truly designed to improve the system? Or is it mainly designed to make the latest loss feel easier to live with? This is a public episode. If you'd like to discuss this with other subscribers or get access to bonus episodes, visit fxaibotlab.substack.com/subscribe

    If You Keep Fixing the Strategy, You May Lose the Ability to Understand It
  6. 6d ago

    It Wasn’t the Entry or the Exit: Why I Moved GateGrid AI From GBPUSD to EURUSD

    My five MT5 trading bots finished July 20 with a combined realized loss of ¥542. The closed trades produced three wins and five losses. The average winning trade made ¥32.7, while the average losing trade lost ¥128. That gives an average payoff ratio of only 0.26. BoundSniper Bot was the only system to finish positive, earning ¥16. GateGrid AI lost ¥151, LLMBridgeTrader lost ¥167, and ML_ScoreAnalyst lost ¥240. I did not receive a confirmed report for MAribbonTrader, so I recorded it as an unverified ¥0 rather than assuming that it made no trades. When I first reviewed the day, I thought the main issue was the exit logic. Several different bots were producing the same pattern: small profits were closed quickly, while larger losses were allowed to remain. That interpretation was not completely wrong. However, after a deeper investigation into GateGrid AI, I reached a different conclusion. The exits were weak, but improving them was not enough. Better entry selection was not enough either. The GBPUSD version of the strategy could not produce a positive expected value under realistic trading costs. The real issue was not simply how intelligent the bot was. It was the relationship between the strategy, the currency pair, and the cost paid on every trade. The July 20 loss became the final reason to reconsider whether GateGrid AI should continue trading GBPUSD at all. Results by Bot GateGrid AI: -¥151 GateGrid AI traded GBPUSD and finished with zero wins and two losses. A buy stop was triggered first. The sell-side order was then triggered as well, and both positions were closed roughly one second later. The two results were -¥135 and -¥16. Looking only at this sequence, the problem appeared to be the position-management process after the opposite side was filled. Should the system keep both positions as a hedge? Should it treat the second fill as a reversal and close the first position? Should it classify the situation as abnormal and close everything? The trade report did not show which rule caused the exit. In the past, I would have responded by adding more detailed exit logs and adjusting the position-management logic. In fact, I had already made many such adjustments. The long-term performance still failed to improve. BoundSniper Bot: +¥16 BoundSniper Bot traded USDJPY. It bought at 162.348 and closed approximately four minutes later at 162.364, producing a ¥16 profit. One trade is not enough to evaluate the quality of the underlying signal. However, the execution path worked correctly. The bot received the TradingView webhook, placed the MT5 order, closed the position, and left nothing open. BoundSniper Bot does not predict the market by itself. Its job is to carry an external TradingView signal into MT5. For that reason, the important risks are different: communication latency, duplicate orders, symbol conversion failures, rejected orders, and missed exits. The profit was small, but the execution process was clean. LLMBridgeTrader: -¥167 LLMBridgeTrader traded EURUSD. Its three results were -¥141, +¥73, and -¥99. That produced one win and two losses. The average win was ¥73, while the average loss was ¥120, giving an average payoff ratio of 0.61. All three positions were closed at market before reaching their original stop-loss or take-profit levels. This suggests that the LLM-based OPEN, HOLD, CLOSE, and REVERSE decision process was active. But an active decision process is not necessarily a profitable one. Did the model close profitable trades too early? Did it correctly detect a reversal? Did it wait longer when a position was losing than when it was winning? The trade history alone cannot answer those questions. The system needs to record the model name, prompt version, market inputs, confidence score, proposed action, final action, and exact exit reason for every decision. ML_ScoreAnalyst: -¥240 ML_ScoreAnalyst traded GBPJPY. It produced one ¥9 profit and one ¥249 loss. Its average payoff ratio was only 0.04. It would take nearly 28 wins of ¥9 to recover a single ¥249 loss. This bot uses a CatBoost score to select entries. However, a high entry score is not enough when the expected price movement is much smaller than the stop-loss distance. Raising the score threshold alone will not solve the problem. The score threshold, trading session, ATR, entry volatility, stop distance, and target distance need to be tested as one combined policy. The bot also carried an unrealized loss of ¥97 into the next day. That unrealized amount was not included in the realized loss of ¥542. Including it would bring the total daily mark-to-market result to -¥639. MAribbonTrader: Unverified ¥0 I did not receive a July 20 trade report for MAribbonTrader. I therefore recorded it as an unverified ¥0 rather than declaring that it made no trades. For an LLM bot that reads chart images, BUY and SELL are not the only meaningful outputs. WAIT and EXIT are also decisions. The input image, higher-timeframe context, support and resistance levels, model response, and reason for waiting should all be recorded. A day with no trades can still contain valuable information, but only if the system distinguishes between deliberately waiting and failing to run. GateGrid AI Was Winning Most Trades and Still Losing Money I did not judge GateGrid AI from the two losses on July 20 alone. Across its live trading history, the bot won approximately 62–68% of its trades. At first glance, that appears acceptable. Despite that win rate, its live profit factor was only 0.62, and its lifetime loss was approximately ¥19,000. The problem was not just an occasional large loss. The system was losing small amounts on an almost daily basis. Converted into pips, the average winning trade made only 4.3 pips, while the average losing trade lost 15.3 pips. The average loss was roughly 3.5 times larger than the average win. With that payoff structure, the break-even win rate is approximately 78%. The actual win rate of 62–68% was not close enough. A minor improvement in entry accuracy could not bridge the gap. This asymmetry was not simply a programming bug. GateGrid AI closes profitable positions relatively quickly and adds exposure when the market moves against the grid. Small gains are collected frequently, but losing baskets become much heavier. The negative skew was embedded in the strategy itself. GBPUSD Trading Costs Were Too Large Relative to the Average Win Spread was another factor quietly damaging the system. In live observations, GBPUSD spread sometimes reached roughly 1.2 pips. For a strategy whose average winning trade was only 4.3 pips, that cost was substantial. A 1.2-pip spread consumes about 28% of the gross winning distance. In my cross-pair simulations, I used a 0.7-pip spread for GBPUSD. Even under that more favorable assumption, it remained expensive compared with the roughly 0.3-pip conditions available on EURUSD and USDJPY. For a strategy targeting large moves, a difference of 0.4 pips may be relatively minor. For a system repeatedly collecting around four pips, that difference sits near the center of the expected value calculation. Reducing the spread paid on every trade can matter more than improving entry accuracy by a few percentage points. I Had Already Made Extensive Exit Adjustments GateGrid AI’s exits had not been ignored. I increased the trailing ratchet from 0.7 to 0.9. I added a time-decay mechanism that gradually reduced the global stop-loss distance to 15 pips after 180 minutes. I introduced an ¥800 basket loss limit. I blocked new entries on Mondays and before the trading curfew. These changes reduced the size of the tail losses. However, they did not close the gap between the required 78% win rate and the actual win rate of roughly 68%. Exit adjustments could reduce the severity of the losses, but they could not reverse the expected value of the strategy. That left one remaining possibility: improve the entries. Six Attempts to Improve Entry Quality Failed I used one rule for every experiment. A change would only be accepted if it improved performance consistently across multiple periods. A policy that worked in only one selected period would not be considered valid. Regime Switching I tested a model designed to classify whether the market was ranging or breaking out and then change the grid behavior accordingly. The holdout AUC was 0.57, and the resulting trading policy showed no improvement. The model could describe something resembling market conditions, but it could not separate profitable conditions from unprofitable ones. Gate Model Version 2 I used 16,715 previously unused market snapshots and generated counterfactual labels to rebuild the entry gate. The real holdout AUC reached 0.61. Despite the higher classification score, the trading policy became worse by ¥46 per trade. A model can improve its statistical metric while reducing actual trading performance. This experiment also revealed that the existing combined policy of threshold filtering, Ollama judgment, and the clean gate was better than simply sorting trades by the model score. Replacing the LLM I attempted a shadow test using gpt-oss:20b in place of the current Ollama decision model. Under the current configuration, however, the model returned empty responses. It appeared faster only because it was not producing a usable decision. The comparison could not evaluate judgment quality, so the replacement was rejected. One-Sided Grids Ollama produced a directional opinion on nearly every setup, yet the grid placed orders on both sides roughly 98% of the time. I tested using the direction signal to place orders on only one side. The result was -¥268 over the full period and +¥441 over the recent period. It improved one period while damaging another, leaving the combined result close to neutral. The cost of two-sided whipsaws was replaced by larger losses when the directional prediction was wrong. Full Exit-Space Search I perf

    It Wasn’t the Entry or the Exit: Why I Moved GateGrid AI From GBPUSD to EURUSD
  7. Jul 18

    The Day Was Lost at the Exit, Not the EntryJuly 17

    Conclusion The five-bot portfolio finished July 17 at -1,362 yen realized, with another -175 yen unrealized on an open ML_ScoreAnalyst position. The combined mark-to-market result was therefore -1,537 yen. The loss itself is not the most useful part of the record. Exit structure separated the bots far more clearly than entry style did. MAribbonTrader won only one of two trades, yet ended positive because its average winner was 1.74 times its average loser. GateGrid AI, LLMBridgeTrader, and ML_ScoreAnalyst produced seven losing closes between them without a single winner to absorb the damage. The -602 yen stop on ML_ScoreAnalyst made me pause. It was not an unusual malfunction; it appears to be the intended fixed-stop design doing exactly what it was told to do. That may be more uncomfortable than a software error, because it points back to the payoff geometry itself. Bot-by-Bot Results ■ GateGrid AI -393 yenRecord: 0W / 3L (Win rate 0.0%)Gross profit: 0 yenGross loss: -393 yenPayoff ratio: Not availableMax loss: -252 yen ■ BoundSniper Bot +10 yenRecord: 1W / 0L (Win rate 100.0%)Gross profit: +10 yenGross loss: 0 yenPayoff ratio: Not availableMax loss: 0 yen ■ LLMBridgeTrader -479 yenRecord: 0W / 2L (Win rate 0.0%)Gross profit: 0 yenGross loss: -485 yenSwap: +6 yenPayoff ratio: Not availableMax loss: -290 yen ■ ML_ScoreAnalyst -602 yen realizedRecord: 0W / 1L (Win rate 0.0%)Gross profit: 0 yenGross loss: -602 yenPayoff ratio: Not availableMax loss: -602 yenOpen P/L: -175 yen ■ MAribbonTrader +102 yenRecord: 1W / 1L (Win rate 50.0%)Gross profit: +240 yenGross loss: -138 yenPayoff ratio: 1.74Max loss: -138 yen ■ Total -1,362 yen realizedRecord: 2W / 7L (Win rate 22.2%)Gross profit: +250 yenGross loss: -1,618 yenSwap: +6 yenPayoff ratio: 0.54Max loss: -602 yenOpen P/L: -175 yenResult including open P/L: -1,537 yen Today’s Theme: An Entry Filter Cannot Rescue a Weak Exit These five bots do not make decisions in the same way. BoundSniper relays TradingView instructions. ML_ScoreAnalyst scores a setup with CatBoost. GateGrid AI adds several entry gates before allowing a trade. LLMBridgeTrader lets an LLM choose OPEN, HOLD, CLOSE, or REVERSE. MAribbonTrader asks a local model to read chart structure and then trades around that interpretation. Despite those differences, the day converged on one issue: what happened after entry. A bot can reject mediocre setups, score a breakout correctly, or produce a persuasive market explanation. None of that guarantees a durable result if the position is held until a distant fixed stop, if reversal handling creates overlapping exposure, or if the model does not abandon its original thesis soon enough. The useful experiment is no longer just “Did the model pick the right direction?” It is “What information was available when the trade should have been closed, and what did the bot decide to do with it?” GateGrid AI: Multiple Gates, but the Exit Sequence Still Hurt GateGrid AI closed three losing GBPUSD trades for -393 yen. The first short was opened at 1.34598 and covered at 1.34753 for -252 yen. That was the largest loss inside this bot. The later sequence deserves more attention. A buy was filled at 1.34762, then a sell was filled at 1.34681. Both sides were closed at 10:17, producing losses of -130 yen and -11 yen. The record shows simultaneous opposing exposure and an immediate flattening sequence. That looks less like a simple bad directional call and more like a coordination problem around reversal, hedging, or grid shutdown. GateGrid’s CatBoost and Ollama layers are designed to be selective before entry. On this day, the missing evidence is what happened after those gates opened. The next log review should align the model score, Ollama response, active grid state, close trigger, and any reversal flag on the same timeline. Without that, tuning the entry threshold would be guesswork. BoundSniper Bot: The Bridge Worked, but One Tiny Win Proves Little BoundSniper opened a USDJPY short at 162.255 and closed it 45 seconds later at 162.245 for +10 yen. The trade was clean, fast, and profitable. That is encouraging from an execution perspective. The TradingView instruction reached MT5, the position was opened, and the exit was transmitted without a visible operational failure. Since BoundSniper does not create the market thesis itself, this is exactly the part of the system it needs to perform well. Still, a 100% win rate from one trade is mostly decoration. There was no losing trade, so the payoff ratio cannot be calculated. The result says the bridge functioned; it does not yet say the upstream TradingView strategy has an edge. LLMBridgeTrader: The LLM Had Control of the Exit, but the Hard Stop Did the Work LLMBridgeTrader finished at -479 yen after swap. One position closed for -290 yen, while a later EURUSD short lost -195 yen. The second trade is the cleaner test because both entry and exit appear in the day’s report. The bot sold at 1.14275 at 14:00 and exited at 1.14395 at 17:17. The position remained open for more than three hours and eventually closed at the stop level. This bot is allowed to return HOLD, CLOSE, or REVERSE. That makes the exit path the central part of the experiment. Yet the live result looks no more adaptive than a trade held until a mechanical stop. I cannot say the LLM ignored an obvious exit without seeing its decision logs, but the record gives no sign that its broader authority improved the outcome. For the next review, every HOLD decision should be stored with current unrealized P/L, recent price structure, confidence, and the reason the model rejected CLOSE. The most valuable training examples may be the moments when the model kept defending a position that later stopped out. ML_ScoreAnalyst: The Model Score Is Only Half the Bet ML_ScoreAnalyst bought GBPJPY at 218.605 and was stopped at 218.003 for -602 yen. It then opened a new short that remained active at the end of the report with -175 yen unrealized. The closed loss is consistent with the bot’s roughly 60-pip stop setting. The profit target is around 25 pips. That structure needs a win rate of about 70.6% before trading costs just to break even. A scoring model can be directionally useful and still struggle under that burden. This is why the -602 yen loss matters beyond one bad trade. It is the natural consequence of a design where one full stop requires more than two normal target wins to repair. Raising the CatBoost threshold may reduce weak entries, but threshold tuning alone will not fix an unfavorable payoff profile. The open short also matters. Realized performance was -602 yen, but actual end-of-day exposure made the bot’s contribution -777 yen on a mark-to-market basis. The next test should compare the existing 60/25 structure with volatility-adjusted exits and a less asymmetric fixed alternative. MAribbonTrader: A 50% Win Rate Was Enough MAribbonTrader was the most balanced result of the day. Its first GBPCAD short earned +240 yen. Its second short lost -138 yen. The final result was +102 yen with a 50% win rate and a payoff ratio of 1.74. That is the cleanest exit profile in the group. The winner was allowed to reach its target, while the loser remained smaller than the prior gain. The second loss included some slippage around the stop, but it did not erase the first trade. Two trades are not enough to validate chart-reading intelligence. The model may have read the MAribbon context well, or it may simply have landed on a favorable pair of trades. What can be said from the execution record is narrower and more useful: the exit geometry gave the bot room to survive an ordinary loss. For this bot, the next layer of analysis should connect each result to the image prompt, the detected ribbon state, the model’s WAIT or entry rationale, and the reason for exit. The positive result is welcome, but the reusable evidence lives in those logs. Summary The portfolio’s 22.2% win rate was weak, but the deeper issue was the total payoff ratio of 0.54. Gross profits reached only +250 yen against -1,618 yen in gross losses. A system cannot filter its way out of that imbalance forever. The next improvement should be built around exit snapshots rather than another round of entry optimization. For every open position, the bots need a record of maximum favorable excursion, maximum adverse excursion, model confidence, exit recommendation, and the reason a close was postponed. That would show whether losses came from poor entries, slow recognition, rigid stops, or confused reversal handling. Bots reveal their real character after they are already in the market. July 17 made that part unusually visible. This is a public episode. If you'd like to discuss this with other subscribers or get access to bonus episodes, visit fxaibotlab.substack.com/subscribe

    The Day Was Lost at the Exit, Not the EntryJuly 17
  8. Jul 17

    The Illusion of Win Rate and the Challenge of the “Exit”

    Looking back at the operating logs of the AI trading bots on July 15 and 16, a clear and somewhat painful theme has emerged. It is the reality that “the timing of the exit (closing a position) is far more important than the frequency or accuracy of the entry.” The Illusion of Win Rate and the Payoff Ratio (Lessons from July 15) On July 15, we ran four MT5 bots, ending the day with a total loss of -1,456 JPY. Some bots recorded a 50% win rate that day, yet the account balance still decreased. Overall, the record was 6 wins and 8 losses (a 42.9% win rate), meaning they were not losing excessively. The bots were not wildly misjudging the market direction all day. The problem was that they were “paying too much when they were wrong.” The payoff ratio was only 0.51, meaning the average profit was only half the size of the average loss. Even if small profits are accumulated, a single loss, inflated by a delayed exit, can wipe them all out. Faced with such results, the “win rate” metric feels like mere noise. AI’s Struggle and the Victory of Simplicity (Lessons from July 16) On the following day, July 16, we ran five bots, including the newly added MAribbonTrader. The realized profit and loss was -464 JPY. On this day, the difference in the bots’ “approaches” clearly divided the results. The most outstanding performer was, ironically, the least “conversational” bot, ML_ScoreAnalyst. Without hesitation, this system successfully hit the take-profit on both of its two trades, generating a profit of +502 JPY on its own. In contrast, the bots that relied on LLMs (Large Language Models) or image recognition AI for judgment struggled with “cutting losses,” “switching positions,” and “staying out of the market.” The decision of whether to “HOLD” or “CLOSE” a position after entering proved to be the most costly challenge. Behavior and Challenges of Each Bot Over these two days, the different risks associated with each of the five bots became apparent. * GateGrid AI On the 15th, despite a 50% win rate, delayed exits made the trades too costly, resulting in a loss. On the 16th, it showed inexplicable behavior, closing a trade in the same second it was opened, resulting in a -13 JPY loss. While the entry filter is functioning, a detailed log review of the handoff between execution and closing is necessary. * BoundSniper Bot This is a rule-based bot that executes signals received from TradingView. It had a 50% win rate on the 15th, but on the 16th, it suffered seven consecutive losses after one win, dropping its win rate to 12.5%. The issue is not the execution engine itself; improving the quality of the upstream signals and revising the exit rules during losing streaks is urgently needed. * LLMBridgeTrader On the 15th, despite a 33.3% win rate, it limited its losses and showed a decent structure with a payoff ratio of 1.23. However, on the 16th, immediately after a loss, it quickly took a position in the opposite direction and held an unrealized loss (-145 JPY). Measures are needed to prevent delayed withdrawals and overreaction (chasing) after a loss. * ML_ScoreAnalyst (formerly MLScore GF-T4) On the 16th, it successfully took profit on two GBPJPY long trades, achieving a commendable result of +502 JPY. However, on the 15th, it had a record of “a winning trade of +300 JPY and a losing trade of -599 JPY,” revealing the issue of its stop-loss being too wide. We must continue to evaluate the “true cost” of this wide stop-loss, rather than just trusting clean wins like those on the 16th. * MAribbonTrader This bot, which uses image recognition AI to read charts, held a position for over 12 hours on the 16th, resulting in the largest single loss of the day (-447 JPY). The market context must have changed during that long holding period, making it necessary to verify whether the exit mechanism is functioning properly. Next Steps: Towards Exit Discipline In live automated trading, what protects the day’s profits is the decision that “I will not hold this position any longer.” The results of these tests teach us that future system improvements should focus on “exit discipline” rather than “entry confidence.” In the next iteration, we will implement the following changes: * Detailed State Logging: Record the position direction, unrealized P/L, model confidence, and the reason for the decision (e.g., HOLD or CLOSE) as a compact log to make the validity of the closing decision verifiable. * Review Maximum Holding Time: Set re-evaluation triggers based on elapsed time to reduce the risks associated with holding positions for a long time. * Introduce Cooldowns: Prevent immediate entries right after a loss is finalized, separating genuine trend reversals from “emotional chasing.” Systems equipped with advanced AI models have, ironically, left us with the most human and difficult question of “when to exit.” However, these clear differences between the systems and the records of their failures are precisely the most valuable data we need to push them to the next level. This is a public episode. If you'd like to discuss this with other subscribers or get access to bonus episodes, visit fxaibotlab.substack.com/subscribe

    The Illusion of Win Rate and the Challenge of the “Exit”

About

Can AI really trade forex? AI FX Bot Lab is a real-time experiment from Japan, where I build and test AI-assisted FX trading bots using MT5, Python, machine learning, and local LLM tools. I share live results, failures, risk lessons, and bot improvements from rule-based, AI-driven, and ML + LLM hybrid systems. Not financial advice. fxaibotlab.substack.com

You Might Also Like