Evaluating AI-Generated Fatwas: A Quality Assessment of ChatGPT and Google Bard Against Authoritative Islamic Rulings

Mu'tashim Billah (1) , Susiknan Azhari (2) , Nurdhin Baroroh (3) , Vivi Rahma (4)
(1) UIN Sunan Kalijaga, Indonesia,
(2) UIN Sunan Kalijaga Yogyakarta, Indonesia,
(3) UIN Sunan Kalijaga Yogyakarta, Indonesia,
(4) UIN Sunan Kalijaga Yogyakarta, Indonesia

Abstract

The use of Artificial Intelligence (AI) in Islamic law has become a global phenomenon, including in Muslim countries such as the United Arab Emirates and Egypt. AI technology began to go viral when ChatGPT and Google Bard were released, claiming to be able to reason like humans. The development of Natural Language Processing (NLP) technologies like ChatGPT and Google Bard has raised a new question: Can AI replace the role of muftis in issuing fatwas? This qualitative study analyzes the capacity of AI as a fatwa issuer by testing ChatGPT and Google Bard with specific prompts related to Islamic law. The results are compared with official fatwas from Nahdlatul Ulama (NU) and Muhammadiyah, which serve as authoritative fatwa standards in Indonesia. Based on the discussion, this article finds that to date, AI NLP technology is unable to reason Islamic law as a mufti would. Therefore, AI technology cannot yet replace the role of a mufti in issuing fatwas. The main reason is that the credibility and authority of fatwas generated by AI technology cannot be guaranteed. Therefore, the use of AI technology as a fatwa issuer is not recommended.


Pemanfaatan Artificial Intelligence (AI) dalam bidang hukum Islam telah menjadi fenomena global, termasuk di negara-negara Muslim seperti Uni Emirat Arab dan Mesir. Teknologi AI mulai sangat viral ketika Chat GPT hingga Google Bard dirilis yang diklaim mampu berpikir layaknya bahasa manusia. Fenomena perkembangan Natural Language Processing (NLP) seperti ChatGPT dan Google Bard memicu pertanyaan baru: Dapatkah AI menggantikan peran mufti dalam berfatwa? Penelitian kualitatif ini menganalisis kapasitas AI sebagai pemberi fatwa melalui uji coba terhadap ChatGPT dan Google Bard dengan prompt spesifik terkait hukum Islam. Hasilnya dibandingkan dengan fatwa resmi Nahdlatul Ulama (NU) dan Muhammadiyah sebagai standar fatwa yang otoritatif di Indonesia. Berdasarkan hasil pembahasan, artikel ini menemukan bahwa hingga saat ini, teknologi AI NLP tidak mampu melakukan nalar hukum Islam sebagaimana seorang nalar seorang mufti. Dengan begitu, teknologi AI belum mampu menggantikan peran seorang mufti untuk berfatwa. Alasan utamanya adalah bahwa hasil fatwa yang digenerate oleh teknologi AI tidak dapat dipertanggungjawabkan kredibilitas dan otoritasnya. Sehingga penggunaan teknologi AI sebagai pemberi fatwa tidak direkomendasikan.

Full text article

Generated from XML file

References

Abdullah, Othman, Amir Shaharuddin, Muhamad Azhari Wahid, and Mohd Shukor Harun. “The Potentials and Challenges of Decision Support System for Islamic Banking and Finance.” European Journal of Islamic Finance 9, no. 3 (2022): 21–29.

Abid, Abubakar, and Mehmet Efe Akengin. “Using AI for Fatwas.” Youtube, 2020. https://youtu.be/Wf5IWJk7ON8?si=mu2-I70H84vahdQN.

Ahmed, Bashir. “The Status of the Use of Artificial Intelligence in Ijtihad.” Karachi Islamicus 1, no. 1 (2021): 1–14.

Aksin, Nur, Rahmat Robi Waliyansyah, and Nugroho Dwi Saputro. “Sistem Pakar Pembagian Harta Waris Menurut Hukum Islam.” Walisongo Journal of Information Technology 2, no. 2 (2020): 115–24. https://doi.org/10.21580/wjit.2020.2.2.5984.

Amari, Hamid, Fadila Atil, Nora Bounour, and Nabila Nouaouria. “Intelligent Tool for Mufti Assistance.” International Journal on Islamic Applications in Computer Science And Technology 3, no. 2 (2015): 1–9.

Andriansyah, Yuli. “The Current Rise of Artificial Intelligence and Religious Studies: Some Reflections Based on ChatGPT.” Millah: Journal of Religious Studies, 2023, ix–xviii.

Bench-Capon, Trevor, Michał Araszkiewicz, Kevin Ashley, Katie Atkinson, Floris Bex, Filipe Borges, Daniele Bourcier, Paul Bourgine, Jack G Conrad, and Enrico Francesconi. “A History of AI and Law in 50 Papers: 25 Years of the International Conference on AI and Law.” Artificial Intelligence and Law 20, no. 3 (2012): 215–319.

Billah, Mu’tashim. “Complete and Incomplete Calculation: Expert Systems Apps on the Special Cases of Islamic Inheritance Law.” Al-Ahwal: Jurnal Hukum Keluarga Islam 16 (2023): 180–210.

Bulten, Wouter, Kimmo Kartasalo, Po-Hsuan Cameron Chen, Peter Ström, Hans Pinckaers, Kunal Nagpal, Yuannan Cai, David F Steiner, Hester Van Boven, and Robert Vink. “Artificial Intelligence for Diagnosis and Gleason Grading of Prostate Cancer: The PANDA Challenge.” Nature Medicine 28, no. 1 (2022): 154–63.

Cheong, Pauline Hope. “Bounded Religious Automation at Work: Communicating Human Authority in Artificial Intelligence Networks.” Journal of Communication Inquiry 45, no. 1 (2021): 5–23.

Elhalwany, Islam, Ammar Mohammed, Khaled Tawfik Wassif, and Hesham A Hefny. “Using Textual Case-Based Reasoning in Intelligent Fatawa QA System.” Int. Arab J. Inf. Technol. 12, no. 5 (2015): 503–9.

Faizin, Nur, Abdul Basid, and Ahmad Munjin Nasih. “Transformation of Santri (Pious Individuals) Perception about Learning via Online Media.” In International Seminar on Language, Education, and Culture (ISoLEC 2021), 232–35. Atlantis Press, 2021.

Ghaly, Mohammed. “Biomedical Scientists as Co-Muftis: Their Contribution to Contemporary Islamic Bioethics.” Die Welt Des Islams 55, no. 3–4 (2015): 286–311.

Haider Syed, Mohammad, Shahnawaz Khan, Mustafa Raza Rabbani, and Yannis E Thalassinos. “An Artificial Intelligence and NLP Based Islamic FinTech Model Combining Zakat and Qardh-Al-Hasan for Countering the Adverse Impact of COVID 19 on SMEs and Individuals,” 2020.

Hidayat, Rahmat. “Analisis Fikih Aktual Dan Hipotesis Atas Eksposisi Eksistensi Artificial Intelligence Dalam Transaksi.” Jurnal Justisia Ekonomika: Magister Hukum Ekonomi Syariah 5, no. 2 (2021).

Humaeroh, Eneng. “Islamic Religious Education Learning and Trends in the Use of Artificial Intelligence: Pembelajaran Pendidikan Agama Islam Dan Tren Penggunaan Artificial Intelligence.” ASIAN: Indonesian Journal of Learning Development and Innovation 1, no. 1 (2023): 31–35.

Ilmiyah, Putri Nur Hidayatul. “Cyber Religion Dan Dampaknya Dalam Buku ‘Mengaji Kepada Ustadz Google’ Karya Ahmad Sarwat (Berdasar Analisis Hermeneutika Gadamer).” UIN Sunan Ampel Surabaya, 2021.

Ilyas, Ilyas, and Anwardi Anwardi. “Sistem Pakar Pembagian Harta Waris Menurut Hukum Islam Dengan Metode Forward Chaining Berbasis Web.” In Seminar Nasional Teknologi Informasi Komunikasi Dan Industri, 2016.

Khairuldin, Wan Mohd Khairul Firdaus Wan, Wan Nur Izzati Wan Nor Anas, Abdul Hanis Embong, Shahir Akram Hassan, Mohd Shukri Hanapi, and Daud Ismail. “Ethics of Mufti in the Declaration of Fatwa According to Islam.” J. Legal Ethical & Regul. Isses 22 (2019): 1.

Khan, Shahnawaz, and Mustafa Raza Rabbani. “Artificial Intelligence and NLP-Based Chatbot for Islamic Banking and Finance.” International Journal of Information Retrieval Research (IJIRR) 11, no. 3 (2021): 65–77.

Kolodner, Janet L. “An Introduction to Case-Based Reasoning.” Artificial Intelligence Review 6, no. 1 (1992): 3–34.

Kusumawati, Ririen. “Kecerdasan Buatan Manusia (Artificial Intelligence); Teknologi Impian Masa Depan.” ULUL ALBAB Jurnal Studi Islam 9, no. 2 (2008): 257–74.

Masrichah, Siti. “Ancaman Dan Peluang Artificial Intelligence (AI).” Khatulistiwa: Jurnal Pendidikan Dan Sosial Humaniora 3, no. 3 (2023): 83–101.

Masudi, Faisal. “Dubai Launches ‘World’s First’ Artificial Intelligence Fatwa Service ‘Virtual Ifta’ Launched by IACAD Can Currently Answer over 200 Questions on Muslim Prayer.” Gulf News, 2023. https://gulfnews.com/uae/dubai-launches-worlds-first-artificial-intelligence-fatwa-service-1.67466584.

Muhammadiyah, MTT. “Fatwa Majelis Tarjih Dan Tajdid Pimpinan Pusat Muhammadiyah Nomor: 08 Tahun 2006.” MTT Muhammadiyah, 2006.

Munshi, Amr Abdullah, Wesam Hasan AlSabban, Abdullah Tarek Farag, Omar Essam Rakha, Ahmad Al Sallab, and Majid Alotaibi. “Automated Islamic Jurisprudential Legal Opinions Generation Using Artificial Intelligence.” Pertanika Journal of Science and Technology 30, no. 2 (2022): 1135–56.

Mutawa, A M, and SUHA MOHAMMAD Al-Terkait. “Al Usouly: An Expert System in the Origins of Islamic Jurisprudence Domain.” Kuwait Journal of Science and Engineering 38 (2011): 143–66.

Nada, Yasser A, and Sultan Aljahdali. “Expert System for Islamic Punishment (ESIP).” In The International Arab Conference on Information Technology (ACIT 2011), 286–93, 2012.

Nouaouria, Nabila, Fadila Atil, Mohamed Tayeb Laskri, Djamel Bouyaya, and Abdel Hamid Amari. “A Cased Based Tool as Intelligent Assistance to Mufti.” Arabian Journal for Science and Engineering 31, no. 1 (2006): 75–90.

Nuonline_id. “Putusan Munas NU 2023 Tentang Artificial Intelligence (AI).” Instagram, 2023. https://www.instagram.com/p/CxdMzTJJIAx/?igshid=NjIwNzIyMDk2Mg%3D%3D.

Nurochman. “Pemanfaatan Kecerdasan Artifisial (Artificial Intelligence) Dalam Bidang Hukum Islam.” Ilmusyariahdoktoral, 2023. https://ilmusyariahdoktoral.uin-suka.ac.id/id/kolom/detail/558/pemanfaatan-kecerdasan-artifisial-dalam-bidang-hukum-islam.

Pan, Yunhe. “Heading toward Artificial Intelligence 2.0.” Engineering 2, no. 4 (2016): 409–13.

Pantan, Frans. “Chatgpt Dan Artificial Intelligence: Kekacauan Atau Kebangunan Bagi Pendidikan Agama Kristen Di Era Postmodern.” Diegesis: Jurnal Teologi 8, no. 1 (2023): 111–24.

Pattaro, Enrico. “A Treatise of Legal Philosophy and General Jurisprudence.” Ratio Juris 19, no. 4 (2006): 489–500.

PBNU. “Keputusan Muktamar Nahdlatul Ulama Ke-1.” PBNU, 1926. https://ia800605.us.archive.org/24/items/SOLUSIPROBLEMATIKAAKTUALHUKUMISLAM/SOLUSI PROBLEMATIKA - AKTUAL- HUKUM ISLAM.pdf.

“Perbandingan Google Bard vs ChatGPT, Mana Yang Lebih Unggul?” eraspace, 2023. https://eraspace.com/artikel/post/perbandingan-google-bard-vs-chatgpt-mana-yang-lebih-unggul.

Purwaningsih, Endang, and Irfan Islami. “Analisis Artificial Intelligence (AI) Sebagai Inventor Berdasarkan Hukum Paten Dan Hukum Islam.” Jurnal Ilmiah Galuh Justisi 11, no. 1 (2023): 1–15.

Reed, Randall. “AI in Religion, AI for Religion, AI and Religion: Towards a Theory of Religious Studies and Artificial Intelligence.” Religions 12, no. 6 (2021): 401.

Rohman, Fathur, Hilda Aualya Azizah, Devi Ardianti, and Aditia Muhammad Noor. “Islam In The Middle Of Ai (Artificial Intelligence) Struggle: Between Opportunities And Threats.” At-Tuhfah: Jurnal Studi Keislaman 12, no. 1 (2023): 19–27.

Rusli, Rusli, Muhammad Syarif Hasyim, and Nurdin Nurdin. “A New Islamic Knowledge Production and Fatwa Rulings: How Indonesia’s Young Muslim Scholars Interact with Online Sources.” Journal of Indonesian Islam 14, no. 2 (2020): 499.

Rusli, Rusli, and Nurdin Nurdin. “Understanding Indonesia Millennia Ulama Online Knowledge Acquisition and Use in Daily Fatwa Making Habits.” Education and Information Technologies 27, no. 3 (2022): 4117–40.

Russell, Stuart Jonathan, and Peter Norvig. Artificial Intelligence: A Modern Approach;[the Intelligent Agent Book]. Prentice hall, 1995.

Salam, Abdul. “Bunga Bank Dalam Perspektif Islam (Studi Pendapat Nahdlatul Ulama Dan Muhammadiyah).” JESI (Jurnal Ekonomi Syariah Indonesia) 3, no. 1 (2016): 77–108.

Sarea, Adel, Mustafa Raza Rabbani, Md Shabbir Alam, and Mohammad Atif. “Artificial Intelligence (AI) Applications in Islamic Finance and Banking Sector.” In Artificial Intelligence and Islamic Finance, 108–21. Routledge, 2021.

Sarwat, Ahmad. “Mengaji Kepada Ustadz Google.” Uin Raden Fatah Palembang, 2018.

Shadiqin, Sehat Ihsan, Tuti Marjan Fuadi, and Siti Ikramatoun. “AI Dan Agama: Tantangan Dan Peluang Dalam Era Digital.” Jurnal Ilmu Sosial Dan Ilmu Politik Malikussaleh (JSPM) 4, no. 2 (2023): 319–33.

Shunichi, D O I. “Technological Development of Driving Support Systems Based on Human Behavioral Characteristics.” IATSS Research 30, no. 2 (2006): 19–28.

Singler, Beth. “An Introduction to Artificial Intelligence and Religion For the Religious Studies Scholar.” Implicit Religion 20, no. 3 (2017).

Surden, Harry. “Artificial Intelligence and Law: An Overview.” Ga. St. UL Rev. 35 (2018): 1305.

Suzuki, Yasushi, and Mohammad Dulal Miah. “Digital Transformation in Islamic Finance: A Critique of Perfectionist’s Views on Islamic Fintech.” In Digital Transformation in Islamic Finance, 15–43. Routledge, 2022.

Tsourlaki, Sofia. “Artificial Intelligence on Sunni Islam’s Fatwa Issuance in Dubai and Egypt.” Islamic Inquiries 1, no. 2 (2022): 107–25.

Unterrainer, Josef M, Christoph P Kaller, Ulrike Halsband, and Benjamin Rahm. “Planning Abilities and Chess: A Comparison of Chess and Non‐chess Players on the Tower of London Task.” British Journal of Psychology 97, no. 3 (2006): 299–311.

Urbina, Fabio, Filippa Lentzos, Cédric Invernizzi, and Sean Ekins. “Dual Use of Artificial-Intelligence-Powered Drug Discovery.” Nature Machine Intelligence 4, no. 3 (2022): 189–91.

Watson, Ian. “Case-Based Reasoning Is a Methodology Not a Technology.” Knowledge-Based Systems 12, no. 5–6 (1999): 303–8.

Zulfah, Evie Miftalia, Yayan Suryana, and Eva Latipah. “Pandangan Mahasiswa Psikologi UIN Sunan Kalijaga Terhadap Cyber Religion.” Jurnal Ilmiah Profesi Pendidikan 8, no. 3 (2023): 1568–76.

Authors

Mu'tashim Billah
aim28121992@gmail.com (Primary Contact)
Susiknan Azhari
Nurdhin Baroroh
Vivi Rahma
Billah, M., Azhari, S., Baroroh, N., & Rahma, V. (2023). Evaluating AI-Generated Fatwas: A Quality Assessment of ChatGPT and Google Bard Against Authoritative Islamic Rulings. Asy-Syir’ah: Jurnal Ilmu Syari’ah Dan Hukum, 57(1), 136–163. https://doi.org/10.14421/ajish.v57i1.1032

Article Details