Integrasi Embedding Multiformat untuk Representasi Semantik Big Data Smart City: Analisis Etika Penelitian, AI Ethics, dan Tantangan Publikasi Ilmiah di Era Teknologi Lanjut
Downloads
How to Cite
Penelitian ini bertujuan menganalisis manfaat representasi semantik dan memetakan risiko etika pada pipeline embedding multimodal dalam pengolahan Big Data Smart City. Penelitian menggunakan desain sintesis literatur yang dipadukan dengan studi kasus konseptual, analisis hermeneutik teknologi, dan pemetaan risiko berbasis pipeline. Analisis mencakup lima komponen utama, yaitu Text Encoder, Visual Encoder, Cross-Modal Alignment, Fusion Layer, dan Semantic Output Layer. Hasil penelitian menunjukkan bahwa integrasi data tekstual dan visual dapat memperkaya konteks semantik, memperkuat hubungan informasi antarmodalitas, serta mempertahankan konsistensi representasi pada dokumen kebijakan yang kompleks. Namun, manfaat tersebut disertai lima risiko utama, yaitu bias representasional, privasi dan indirect disclosure, dual-use, surveillance dan profiling otomatis, serta asimetri kekuasaan informasi. Fusion Layer teridentifikasi sebagai komponen dengan risiko paling tinggi karena menggabungkan bias dan potensi penyalahgunaan dari beberapa modalitas, sedangkan Cross-Modal Alignment menunjukkan mekanisme mitigasi yang masih terbatas. Integrasi prinsip autonomy, beneficence, justice, dan consent dengan fairness, accountability, transparency, explainability, serta manajemen risiko menghasilkan kerangka evaluasi etika yang dapat diterapkan sepanjang siklus hidup sistem. Penelitian merekomendasikan penerapan ethical checkpoints, audit bias, dokumentasi dataset dan model, logging, pembatasan tujuan penggunaan, serta human oversight. Karena berbasis studi kasus konseptual, kerangka ini masih memerlukan validasi ahli dan pengujian empiris menggunakan dataset Smart City aktual.
Ethical Risk Mapping in Multimodal Embedding Pipelines for Semantic Representation of Smart City Big Data: A Literature Synthesis and Conceptual Case Study
This study aims to analyze the benefits of semantic representation and map ethical risks within multimodal embedding pipelines used to process Smart City Big Data. The study employed a literature synthesis design combined with a conceptual case study, technological hermeneutic analysis, and pipeline-based risk mapping. The analysis covered five main components: the Text Encoder, Visual Encoder, Cross-Modal Alignment, Fusion Layer, and Semantic Output Layer. The findings indicate that integrating textual and visual data can enrich semantic context, strengthen cross-modal information relationships, and maintain representational consistency in complex policy documents. However, these benefits are accompanied by five major risks: representational bias, privacy and indirect disclosure, dual use, automated surveillance and profiling, and information-power asymmetry. The Fusion Layer was identified as the component with the highest risk because it combines bias and the potential misuse of information from multiple modalities, whereas Cross-Modal Alignment still has limited mitigation mechanisms. Integrating the principles of autonomy, beneficence, justice, and consent with fairness, accountability, transparency, explainability, and risk management produced an ethical evaluation framework that can be applied throughout the system lifecycle. The study recommends implementing ethical checkpoints, bias audits, dataset and model documentation, logging, purpose limitation, and human oversight. Because the study is based on a conceptual case scenario, the proposed framework still requires expert validation and empirical testing using actual Smart City datasets.
Berg, H., Hall, S., Bhalgat, Y., Kirk, H., Shtedritski, A., & Bain, M. (2022). A prompt array keeps the bias away: Debiasing vision-language models with adversarial learning. AACL-IJCNLP 2022. https://aclanthology.org/2022.aacl-main.61/
Cabello, L., Bugliarello, E., Brandl, S., & Elliott, D. (2023). Evaluating bias and fairness in gender-neutral pretrained vision-and-language models. Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing. https://aclanthology.org/2023.emnlp-main.525/
Gstrein, O. J. (2024). Data autonomy: Beyond personal data abuse, sphere transgression, and datafied gentrification in smart cities. Ethics and Information Technology, 26, Article 61. https://doi.org/10.1007/s10676-024-09799-x
Janghorbani, S., & De Melo, G. (2023). Multi-modal bias: Introducing a framework for stereotypical bias assessment beyond gender and race in vision-language models. In Proceedings of the 17th Conference of the European Chapter of the Association for Computational Linguistics (pp. 1725–1735). Association for Computational Linguistics. https://doi.org/10.18653/v1/2023.eacl-main.126
Manzoor, M. A., Albarri, S., Xian, Z., Meng, Z., Nakov, P., & Liang, S. (2023). Multimodality representation learning: A survey on evolution, pretraining, and its applications. ACM Transactions on Multimedia Computing, Communications, and Applications. https://arxiv.org/abs/2302.00389
Mitchell, M., Wu, S., Zaldivar, A., Barnes, P., Vasserman, L., Hutchinson, B., Spitzer, E., Raji, I. D., & Gebru, T. (2019). Model cards for model reporting. In Proceedings of the Conference on Fairness, Accountability, and Transparency (pp. 220–229). Association for Computing Machinery. https://doi.org/10.1145/3287560.3287596
Organisation for Economic Co-operation and Development. (2023). Advancing accountability in AI: Governing and managing risks throughout the lifecycle for trustworthy AI (OECD Digital Economy Papers No. 349). OECD Publishing. https://doi.org/10.1787/2448f04b-en
Ortega-Bolaños, R., Bernal-Salcedo, J., Ortiz, M. G., Galeano Sarmiento, J., Ruz, G. A., & Tabares-Soto, R. (2024). Applying the ethics of AI: A systematic review of tools for developing and assessing AI-based systems. Artificial Intelligence Review, 57, Article 110. https://doi.org/10.1007/s10462-024-10740-3
Ruggeri, F., & Nozza, D. (2023). A multi-dimensional study on bias in vision-language models. Findings of the Association for Computational Linguistics: ACL 2023. https://aclanthology.org/2023.findings-acl.403/
Srinivasan, T., & Bisk, Y. (2022). Worst of both worlds: Biases compound in pre-trained vision-and-language models. In Proceedings of the 4th Workshop on Gender Bias in Natural Language Processing (pp. 77–85). Association for Computational Linguistics. https://doi.org/10.18653/v1/2022.gebnlp-1.10
Tabassi, E. (2023). Artificial intelligence risk management framework (AI RMF 1.0) (NIST AI 100-1). National Institute of Standards and Technology. https://doi.org/10.6028/NIST.AI.100-1
Thiebes, S., Lins, S., & Sunyaev, A. (2021). Trustworthy artificial intelligence. Electronic Markets, 31, 447–464. https://doi.org/10.1007/s12525-020-00441-4
United Nations Educational, Scientific and Cultural Organization. (2021). Recommendation on the ethics of artificial intelligence. https://unesdoc.unesco.org/ark:/48223/pf0000381137
van Noordt, C., & Misuraca, G. (2022). Artificial intelligence for the public sector: Results of landscaping the use of AI in government across the European Union. Government Information Quarterly, 39(3), Article 101714. https://doi.org/10.1016/j.giq.2022.101714
Ziosi, M., Hewitt, B., Juneja, P., Taddeo, M., & Floridi, L. (2024). Smart cities: Reviewing the debate about their ethical implications. AI & Society, 39, 1185–1200. https://doi.org/10.1007/s00146-022-01558-0
Copyright (c) 2026 Endang Sri Sumanti, Didik Dwi Prasetya, Hakkun Elmunsyah, Siti Sendari

This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
