Syntactic Challenges in ChatGPT-5’s Translation of English News Texts into Standard Malay: A Generative Transformation Model

Amieziezaitul Syazlien Ezzeq Ezrynah Amirul Syafiee; Lalu Nurul  Yaqin

doi:10.36312/jolls.v6i2.4590

Authors

Amieziezaitul Syazlien Ezzeq Ezrynah Amirul Syafiee Universiti Brunei Darussalam
Lalu Nurul Yaqin Universiti Brunei Darussalam

DOI:

https://doi.org/10.36312/jolls.v6i2.4590

Keywords:

ChatGPT-5, Generative AI, English-to-Malay translation, Generative transformation theory

Abstract

The growing use of AI translation has increased the need to evaluate whether generative models can produce grammatically accurate translations for underrepresented languages such as Malay. English-to-Malay translation remains challenging because Malay syntax requires accurate verb affixation, modifier placement, phrase ordering, and noun phrase + verb phrase (FN + FK) alignment in Standard Malay. This study examines the syntactic and lexical accuracy of ChatGPT-5 in translating English news texts into Standard Malay, with a focus on FN + FK structures. Grounded in Generative Transformation Theory and Nik Safiah Karim’s Malay grammar framework, the research analyzes how underlying English sentence structures are transformed into Malay surface structures. Using a qualitative descriptive linguistic design supported by descriptive error analysis, authentic bilingual sentences from the Borneo Bulletin were analyzed across social, economic, technological, cultural, and sports domains. The samples were selected from news sentences containing FN + FK structures, translated using a standardized ChatGPT-5 prompt, coded according to syntactic error categories, and validated through review by two qualified linguists and Malay grammar specialists. Findings show that ChatGPT-5 generally preserves complex sentence structures, including verb affixation, modifier placement, and phrase order, while accurately translating culturally embedded expressions and technical terms, such as mock cheque, Turnaround, and king of fruits. Minor syntactic deviations were observed, particularly in morphological mapping, modifier sequencing, and lexical narrowing, but they did not significantly affect the meaning. The study demonstrates ChatGPT-5’s potential as a supportive AI tool for multilingual translation and highlights the value of syntactically informed evaluation. These insights inform both the theoretical understanding of Malay syntax in AI translation and practical applications for professional, academic, and media contexts.

Downloads

Download data is not yet available.

Author Biographies

Amieziezaitul Syazlien Ezzeq Ezrynah Amirul Syafiee, Universiti Brunei Darussalam

Malay Language, Linguistics and Literature Program, Faculty of Arts and Social Science, Universiti Brunei Darussalam, Brunei Darussalam
Lalu Nurul Yaqin, Universiti Brunei Darussalam

Malay Language, Linguistics and Literature Program, Faculty of Arts and Social Science, Universiti Brunei Darussalam, Brunei Darussalam

References

Bahdanau, D., Cho, K., & Bengio, Y. (2015). Neural machine translation by jointly learning to align and translate. arXiv preprint arXiv:1409.0473. https://doi.org/10.48550/arXiv.1409.0473

Bilad, M. R., Yaqin, L. N., & Zubaidah, S. (2023). Recent progress in the use of artificial intelligence tools in education. Jurnal Penelitian dan Pengkajian Ilmu Pendidikan: e-Saintika, 7(3), 279-314.

Brown, T., Mann, B., Ryder, N., Subbiah, M., Kaplan, J., Dhariwal, P., ... & Amodei, D. (2020). Language models are few-shot learners. Advances in Neural Information Processing Systems, 33, 1877–1901. https://arxiv.org/abs/2005.14165

Borneo Bulletin. (2025, August 17–23). Various news articles. Borneo Bulletin. https://borneobulletin.com.bn

Burchardt, A., Frank, A., & Hahn, U. (2017). Tree-based evaluation of syntactic transfer in machine translation. Computational Linguistics, 43(2), 321–349. https://doi.org/10.1162/coli_a_00285

Chomsky, N. (1965). Aspects of the theory of syntax. MIT Press.

Collins, L., & Ahmad, M. (2012). Standard Malay and regional dialects: Sociolinguistic perspectives. Journal of Southeast Asian Linguistics, 5(2), 87–105.

Costa-Jussà, M. R., & Farrús, M. (2015). Neural machine translation for low-resource languages. In Proceedings of the Workshop on Low-Resource Languages for NLP (pp. 1–12). https://doi.org/10.18653/v1/W15-4001

Costa-Jussà, M. R., & Fonollosa, J. A. R. (2015). Neural machine translation in morphologically rich languages: Challenges and solutions. Computational Linguistics, 41(4), 635–671. https://doi.org/10.1162/COLI_a_00215

Dahlmeier, D., & Ng, H. T. (2012). Better evaluation for grammatical error correction. In Proceedings of the 2012 Conference of the North American Chapter of the Association for Computational Linguistics (pp. 568–572). https://doi.org/10.5555/2380816.2380888

Hutchins, W. J. (2005a). The history of machine translation in a nutshell. In G. Riccardi (Ed.), Machine translation: From research to real users (pp. 3–14). Springer. https://doi.org/10.1007/1-4020-2757-4_1

Hutchins, W. J. (2005b). Early years in machine translation: Memoirs and reflections. Amsterdam: John Benjamins.

Joshi, P., Santy, S., Budhiraja, A., Bali, K., & Choudhury, M. (2021a). The state and fate of linguistic diversity and inclusion in the NLP world. In Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics (pp. 6282–6293). https://doi.org/10.18653/v1/2021.acl-long.492

Karim, N.S. (1995). Tatabahasa Dewan (4th ed.). Kuala Lumpur: Dewan Bahasa dan Pustaka.

Koehn, P. (2009). Statistical machine translation. Cambridge University Press. https://doi.org/10.1017/CBO9780511814358

Larson, M. L. (1998). Meaning-based translation: A guide to cross-language equivalence (2nd ed.). University Press of America.

National University of Singapore. (2021). SINGA MT: Malay machine translation resources. Singapore: NUS Press.

Syafiee, A. S. E. E. A., & Yaqin, L. N. (2025). A comparative analysis of Google Translate and ChatGPT in translating Borneo Bulletin News into standard Malay. Journal of Research on English and Language Learning (J-REaLL), 6(1), 115-126.

Omar, A.H. (2008a). Ensiklopedia bahasa Melayu. Kuala Lumpur: Dewan Bahasa dan Pustaka.

Omar, A.H. (2008b). The Malay language: A comprehensive grammar. Dewan Bahasa dan Pustaka.

OpenAI. (2025, November 30). Introducing ChatGPT-5: Advances in large language models. OpenAI Blog. https://openai.com/blog/chatgpt-5

OpenAI. (2022, August 7). ChatGPT: Optimizing language models for dialogue. OpenAI. https://openai.com/research/chatgpt

Papineni, K., Roukos, S., Ward, T., & Zhu, W. J. (2002). BLEU: A method for automatic evaluation of machine translation. In Proceedings of the 40th Annual Meeting of the Association for Computational Linguistics (pp. 311–318). https://doi.org/10.3115/1073083.1073135

Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., ... & Polosukhin, I. (2017). Attention is all you need. Advances in Neural Information Processing Systems, 30, 5998–6008. https://arxiv.org/abs/1706.03762

Yaqin, L. N., Hassan, H., & Yusof, B. (2025a). Performance And Accuracy Of Chatgpt In Generating Malay Academic Texts: A Comparative Study With Expert Corrections. LLT Journal: A Journal on Language and Language Teaching, 28(1), 495-517.

Yaqin, L. N., Yusof, B., Yusof, N., & Damit, A. R. (2025b). Students' perception of using ChatGPT as an AI-integrated tool in the Malay Language. Jurnal Penelitian dan Pengkajian Ilmu Pendidikan: e-Saintika, 9(1), 13-31.

Yaqin, L. N. (2025c). Emerging research in AI-assisted language learning: A systematic literature review. Multi-Industry Digitalization and Technological Governance in the AI Era, 29-50.