Financial Management Perspective

Financial Management Perspective

Testing Weak-Form Market Efficiency Based on Return Predictability: A Comparison of the Tehran Stock Exchange Composite Index and the S&P 500 Using Econometric and Machine Learning Approaches

Document Type : Original Article

Authors
1 Department of Economics, Faculty of Islamic Studies and Economics, Imam Sadiq University
2 Department of Financial Economics, Faculty of Islamic Studies and Economics, Imam Sadiq University, Tehran, Iran
Abstract
Introduction: The main objective of this study is to test weak-form efficiency in capital markets, using the Tehran Stock Exchange composite index and the S&P 500. The main question is whether returns in these markets are consistent with weak-form efficiency when tested against past price and volume information. Out-of-sample return prediction provides the empirical testing framework, with a zero-return random walk as the statistical benchmark. Further analyses ask whether nonlinear models improve on linear regression and whether Tehran trading-condition indicators add information. These supplementary comparisons support the efficiency test; the indicators neither measure an order book nor isolate the effect of market rules. The design therefore treats statistical predictability as evidence about the information contained in market history, while keeping economic efficiency, risk adjustment, transaction costs, and implementability conceptually separate.

Methods: Daily index data are used to predict the next day’s log return. The standard features include current returns, three return lags, ten-day volatility and five-day mean volume. For Tehran, a second set includes distance from a hypothetical band, its five-day mean, proximity to the band, positive or negative returns with low relative volume, and a period indicator. The combined set contains both groups. Linear regression and LightGBM are compared with the zero-return benchmark in five expanding-window folds. Training and validation come before each test block, with one-row gaps at the selection boundaries. Preprocessing uses training data only. Performance is assessed with forecast errors, test-sample R-squared and direction accuracy. Paired squared-error losses are compared by a Diebold–Mariano test with a standard error robust to changing variance and serial dependence. Checks of result stability vary the volume threshold and initial training share and use a subsample before the period boundary. A separate analysis compares tuned and default LightGBM settings to assess sensitivity to hyperparameters. Models are re-estimated as the training window expands. Performance is summarized both by averaging the five test-fold metrics and by pooling test errors, so fold averages are distinguished from aggregate results.

Findings: For Tehran with standard features, mean fold RMSE is ‪0.011300 for the random walk, ‪0.010504 for linear regression and ‪0.010709 for LightGBM. Both fitted models improve on the benchmark, with HAC p-values of ‪0.0002 and ‪0.0014, respectively. Their difference is not significant in the full-sample baseline. Neither model shows a significant gain over the benchmark for the S&P 500. In Tehran, gains from tuned models remain under the tested volume thresholds and in the subsample before the boundary. However, default LightGBM settings lead to worse performance. This comparison demonstrates sensitivity to hyperparameters, not model robustness. Stability under the tested volume thresholds and subsample choices does not establish stability across model settings. Feature-attribution results are used to describe model behavior rather than to establish causal effects or incremental forecasting value.‬‬‬‬‬‬‬‬‬‬

Conclusions: The zero-return random walk is a statistical forecasting benchmark, not a complete test of weak-form market efficiency. Market efficiency does not require a zero expected return. The absence of significant gains for the S&P 500 therefore does not prove efficiency, while lower forecast errors in Tehran do not by themselves establish inefficiency or net trading profits. LightGBM performance is sensitive to hyperparameters; the default-setting comparison does not establish model robustness. No consistent advantage of nonlinear complexity is found, and a nonsignificant difference does not establish model equivalence. The cross-market comparison is descriptive and cannot identify causal effects of market rules or structure. Accordingly, the evidence supports a cautious, benchmark-dependent interpretation: historical data contain useful predictive content for Tehran under selected specifications, whereas the S&P 500 results do not provide comparable evidence within this sample and research design.
Keywords

Alizadeh Chamazkoti, M., Fathabadi, M., Ghavidel Doostkouei, S., & Mahmoodzadeh, M. (2024). Tehran stock market efficiency: A quantile autoregression approach. Financial Statistical Journal, 7(1), Article 7543. https://doi.org/10.24294/fsj.v7i1.7543
Bergmeir, C., & Benítez, J. M. (2012). On the use of cross-validation for time series predictor evaluation. Information Sciences, 191, 192–213. https://doi.org/10.1016/j.ins.2011.12.028
Campbell, J. Y., Lo, A. W., & MacKinlay, A. C. (1997). The econometrics of financial markets. Princeton University Press.
Diebold, F. X., & Mariano, R. S. (1995). Comparing predictive accuracy. Journal of Business & Economic Statistics, 13(3), 253–263. https://doi.org/10.1080/07350015.1995.10524599
Eghtesad, A., & Mohammadi, E. (2023). Portfolio optimization with return prediction using LSTM, random forest, and ARIMA. Financial Management Perspective, 13(43), 9–28. https://doi.org/10.48308/jfmp.2024.104191 (In Persian).
Fama, E. F. (1970). Efficient capital markets: A review of theory and empirical work. The Journal of Finance, 25(2), 383–417. https://doi.org/10.2307/2325486
Gholami, N., & Shams Gharneh, N. (2024). Presenting an optimized CNN-LSTM model for stock price forecasting in the Tehran Stock Exchange. Financial Management Perspective, 14(45), 123–147. https://doi.org/10.48308/jfmp.2024.104892 (In Persian).
Gu, S., Kelly, B., & Xiu, D. (2020). Empirical asset pricing via machine learning. The Review of Financial Studies, 33(5), 2223–2273. https://doi.org/10.1093/rfs/hhaa009
Harvey, C. R. (1995). Predictable risk and returns in emerging markets. The Review of Financial Studies, 8(3), 773–816. https://doi.org/10.1093/rfs/8.3.773
Hasannezhad, M., Davallou, M., & Shabani, F. (2023). Investigation of the effects of price limit changes on the intraday volatility of Iran’s stock market using realized variance and discrete Fourier transform. Asset Management and Financing, 11(2), 19–34. https://doi.org/10.22108/amf.2023.134778.1755 (In Persian).
Heydari Delooei, A., Vahdati, M., Mohebbi, H., & Bagherpour, N. (2026). Predictability of the Tehran Stock Exchange total index using a hybrid machine learning approach: Analysis of market efficiency and influential variables. Financial Research Journal, 28(2), 464–493. https://doi.org/10.22059/frj.2025.394747.1007738 (In Persian; translated title).
Jafaripour, M., Ramezan Ahmadi, M., Mazaheri, E., & Arman, S. A. (2021). Adjusted capital asset pricing models (CAPMs) with respect to the magnet effect factor (MEF) caused by the range of stock price fluctuations. Journal of Asset Management and Financing, 9(3), 65–88. https://doi.org/10.22108/amf.2022.130725.1699 (In Persian).
Ke, G., Meng, Q., Finley, T., Wang, T., Chen, W., Ma, W., Ye, Q., & Liu, T.-Y. (2017). LightGBM: A highly efficient gradient boosting decision tree. Advances in Neural Information Processing Systems, 30, 3146–3154.
Lo, A. W., & MacKinlay, A. C. (1988). Stock market prices do not follow random walks: Evidence from a simple specification test. The Review of Financial Studies, 1(1), 41–66. https://doi.org/10.1093/rfs/1.1.41
Lundberg, S. M., Erion, G., Chen, H., DeGrave, A., Prutkin, J. M., Nair, B., Katz, R., Himmelfarb, J., Bansal, N., & Lee, S.-I. (2020). From local explanations to global understanding with explainable AI for trees. Nature Machine Intelligence, 2(1), 56–67. https://doi.org/10.1038/s42256-019-0138-9
Nabipour, M., Nayyeri, P., Jabani, H., Mosavi, A., Salwana, E., & Shahab, S. (2020). Deep learning for stock market prediction. Entropy, 22(8), Article 840. https://doi.org/10.3390/e22080840
Namazi, M. (2003). An investigation of the economic performance of the stock exchange market in Iran. Deputy for Economic Affairs, Ministry of Economic Affairs and Finance. (In Persian).
Namazi, M., & Shooshtarian, Z. (1996). An investigation and analysis of the efficiency of the Tehran Stock Exchange market. Financial Research Journal, 2(7–8), 82–104. (In Persian).
Oujimehr, S., Montakhab, A., & Samadi, A. H. (2020). Ranking the efficiency of selected active industries in the Tehran Stock Exchange market: An application of the multifractal detrended fluctuation analysis method. Industrial Economics Research, 4(14), 11–26. (In Persian).
Raei, R., Vahdati, M., Mohebbi, H., & Heydari Delooei, A. (2025). Interpreting forecast the return of the price index of manufacturing industries in the Tehran Stock Exchange using explainable ensemble learning. Financial Management Perspective, 14(48), 55–78. https://doi.org/10.48308/jfmp.2025.238860.1475 (In Persian).
Štrumbelj, E., & Kononenko, I. (2014). Explaining prediction models and individual predictions with feature contributions. Knowledge and Information Systems, 41(3), 647–665. https://doi.org/10.1007/s10115-013-0679-x
Tsay, R. S. (2010). Analysis of financial time series (3rd ed.). John Wiley & Sons.