Generative artificial intelligence (AI) in higher education: a comprehensive review of challenges, opportunities, and implications

Authors

DOI:

https://doi.org/10.47408/jldhe.vi30.1137

Keywords:

ChatGPT, large language models, higher education, academic integrity, bias, misinformation, privacy, opportunities, policy, AI literacy, EDI, copyright

Abstract

This paper explores recent advancements and implications of artificial intelligence (AI) technology, with a specific focus on Large Language Models (LLMs) like ChatGPT 3.5, within the realm of higher education. Through a review of the academic literature, this paper highlights the unprecedented growth of these models and their wide-reaching impact across various sectors. The discussion sheds light on the complex issues and potential benefits presented by LLMs, providing a overview of the field's current state.

In the context of higher education, the paper explores the challenges and opportunities posed by LLMs. These include issues related to educational assessment, potential threats to academic integrity, privacy concerns, the propagation of misinformation, EDI aspects, copyright concerns and inherent biases within the models. While these challenges are multifaceted and significant, the paper emphasizes the availability of strategies to address them effectively and facilitate the successful adoption of LLMs in educational settings.

Furthermore, the paper recognises the potential opportunities to transform higher education. It emphasises the need to update assessment policies, develop guidelines for staff and students, scaffold AI skills development, and find ways to leverage technology in the classroom. By proactively pursuing these steps, higher education institutions (HEIs) can harness the full potential of LLMs while managing their adoption responsibly.

In conclusion, the paper urges HEIs to allocate resources to handle the adoption of LLMs effectively. This includes ensuring staff AI readiness and taking steps to modify their study programmes to align with the evolving educational landscape influenced by emerging technologies.

Author Biography

Michal Bobula, University of West England

Michal Bobula is a Senior Lecturer and Programme Leader for Accounting and Finance at the University of the West of England in Bristol, UK (UWE Bristol). He is a member of the university AI community of practice and co-leads the efforts to incorporate generative AI into teaching, learning, and assessment strategies in the College of Business and Law.   

References

Abdelghani, R., Wang, Y.H., Yuan, X., Wang, T., Sauzéon, H., and Oudeyer, P.Y. (2023) GPT-3-driven pedagogical agents for training children's curious question-asking skills. arXiv:2211.14228v6. https://doi.org/10.48550/arXiv.2211.14228.

Atlas, S. (2023) ChatGPT for Higher Education and Professional Development: A Guide to Conversational AI, Available at: https://digitalcommons.uri.edu/cba_facpubs/548 (Accessed: 15 July 2023).

Azaria, A., Azoulay, R. and Reches, S. (2023). ChatGPT is a Remarkable Tool—For Experts. Available at: https://arxiv.org/pdf/2306.03102.pdf (Accessed 2 August 2023).

BBC News (2023) 'ChatGPT owner in probe over risks around false answers', BBC News. Available at: https://www.bbc.com/news/business-66196223 (Accessed: 2 August 2023).

Bendix, T., (2023) ‘TikTok UK Statistics (2023), Everything you need to know’, Social Films. [blog] Available at: https://www.socialfilms.co.uk/blog/tiktok-uk-statistics (Accessed 29 June 2023).

Bloomberg (2023a) Bloomberg Terminal. Available at: https://www.bloomberg.com/professional/solution/bloomberg-terminal/?utm_medium=Adwords_SEM&utm_source=pdsrch&utm_content=Terminal&utm_campaign=835926&utm_term=bloomberg+professional+terminal&tactic=835926&gad_source=1&gclid=CjwKCAiA5L2tBhBTEiwAdSxJX3bxnX7YGTpHAzEjdthbr4DQQh_bUFmLe0R6HSfUWV1fOkGVgC4DnBoCLTkQAvD_BwE. (Accessed: 12 July 2023).

Bloomberg (2023b) Introducing BloombergGPT, Bloomberg’s 50-billion parameter large language model, purpose-built from scratch for finance. Available at: https://www.bloomberg.com/company/press/bloomberggpt-50-billion-parameter-llm-tuned-finance/. (Accessed: 12 July 2023).

Burger, B., Kanbach, D.K., Kraus, S., Breier, M., and Corvello, V. (2023) ‘On the use of AI-based tools like ChatGPT to support management research’, European Journal of Innovation Management, 26(7), pp.233-241. https://doi.org/10.1108/EJIM-02-2023-0156.

Celik, I. (2023) ‘Towards Intelligent-TPACK: An empirical study on teachers’ professional knowledge to ethically integrate artificial intelligence (AI)-based tools into education’, Computers in Human Behavior, (online) 138. https://doi.org/10.1016/j.chb.2022.107468.

Centre for Teaching and Learning (2023) Four lessons from ChatGPT: Challenges and opportunities for educators. University of Oxford. Available at: https://www.ctl.ox.ac.uk/article/four-lessons-from-chatgpt-challenges-and-opportunities-for-educators (Accessed: 13 July 2023).

Center for Information Technology and Society (2023) Why we fall for fake news. University of California Santa Barbara. Available at: https://www.cits.ucsb.edu/fake-news/why-we-fall (Accessed: 03 July 2023).

Chen, H., Jiao, F., Li, X., Qin, C., Ravaut, M., Zhao, R., Xiong, C. and Joty, S. (2023) ChatGPT’s One-year Anniversary: Are Open-Source Large Language Models Catching up? Available at: https://arxiv.org/abs/2311.16989. (Accessed: 15 January 2024).

Cooper, G. (2023) ‘Examining Science Education in ChatGPT: An Exploratory Study of Generative Artificial Intelligence’, Journal of Science Education and Technology, 32, pp.444-452. https://doi.org/10.1007/s10956-023-10039-y.

CRADLEdeakin (2023) ChatGPT webinar #1 - What do we need to know now? (Video). YouTube. Available at: https://www.youtube.com/watch?v=mCCqf6tHI24 (Accessed: 3 July 2023).

Crawford, J., Cowling, M., and Allen, K., A. (2023) ‘Leadership is needed for ethical ChatGPT: Character, assessment, and learning using artificial intelligence (AI)’, Journal of University Teaching and Learning Practice, 20(3). https://doi.org/10.53761/1.20.3.02.

Creamer, E. (2023) 'Authors file a lawsuit against OpenAI for unlawfully ‘ingesting’ their books', The Guardian, 5 July. Available at: https://www.theguardian.com/books/2023/jul/05/authors-file-a-lawsuit-against-openai-for-unlawfully-ingesting-their-books (Accessed: 05 July 2023).

Currie, G.M., (2023) ‘Academic integrity and artificial intelligence: is ChatGPT hype, hero or heresy?’, Seminars in Nuclear Medicine. Available at: https://www.sciencedirect.com/science/article/abs/pii/S0001299823000363 (Accessed: 13 June 2023).

Dalalah, D., and Dalalah, O.M.A. (2023) ‘The false positives and false negatives of generative AI detection tools in education and academic research: The case of ChatGPT’, The International Journal of Management Education, 21(2), 100822.

Department for Education, (2023) Ethics, Transparency and Accountability Framework for Automated Decision-Making. GOV.UK. Available at: https://www.gov.uk/government/publications/ethics-transparency-and-accountability-framework-for-automated-decision-making/ethics-transparency-and-accountability-framework-for-automated-decision-making (Accessed: 28 June 2023).

Dixit, P. (2023) 'Google faces lawsuit alleging data scraping and copyright violations for AI development', Business Today, 12 July. Available at: https://www.businesstoday.in/technology/news/story/google-faces-lawsuit-alleging-data-scraping-and-copyright-violations-for-ai-development-389340-2023-07-12 (Accessed: 12 July 2023).

Else, H. (2023) ‘Abstracts written by ChatGPT fool scientists’, Nature, 613, p. 423. Available at: https://www.nature.com/articles/d41586-023-00056-7 (Accessed: 29 May 2023).

Eke, D.O., (2023) ‘ChatGPT and the rise of generative AI: Threat to academic integrity?’, Journal of Responsible Technology, 13(2023), pp.100060. https://doi.org/10.53761/1.20.3.02.

Dwivedi, Y.K., Kshetri, N., Hughes, L., Slade, E.L., Jeyaraj, A., Kar, A.K., Baabdullah, A.M., Koohang, A. et al. (2023) ‘Opinion Paper: “So what if ChatGPT wrote it?” Multidisciplinary perspectives on opportunities, challenges and implications of generative conversational AI for research, practice and policy.’, International Journal of Information Management, vol. 71, 102642, pp. 102642. https://doi.org/10.1016/j.ijinfomgt.2023.102642.

Feizi, S., and Huang, F. (2023) Is AI-Generated Content Actually Detectable? College of Computer, Mathematical, and Natural Sciences, University of Maryland. Available at: https://cmns.umd.edu/news-events/news/ai-generated-content-actually-detectable (Accessed 4 July 2023).

Franzoni, V. (2023) ‘From Black Box to Glass Box: Advancing Transparency in Artificial Intelligence Systems for Ethical and Trustworthy AI’, Computational Science and Its Applications – ICCSA 2023 Workshops. ICCSA 2023. Lecture Notes in Computer Science, vol 14107. Springer, Cham. Available at: https://link.springer.com/chapter/10.1007/978-3-031-37114-1_9 (Accessed 4 July 2023).

Geerling, W., Mateer, G. D., Wooten, J., and Damodaran, N. (2023) 'ChatGPT has Mastered the Principles of Economics: Now What?', SSRN. Available at: https://papers.ssrn.com/sol3/papers.cfm?abstract_id=4356034 (Accessed: 29 July 2023)

Gilson, A., Safranek, C., Huang, T., Socrates, V., Chi, L., Taylor, R.A. and Chartash, D. (2023) ‘How Does ChatGPT Perform on the United States Medical Licensing Examination? The Implications of Large Language Models for Medical Education and Knowledge Assessment’, JMIR Medical Education, 9. Available at: https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9947764/ (Accessed 03 July 2023).

Gimpel, H., Hall, K., Decker, S., Eymann, T., Lämmermann, L., Maedche, A., Röglinger, M., Ruiner, C., et al. (2023) Unlocking the Power of Generative AI Models and Systems such as GPT-4 and ChatGPT for Higher Education A Guide for Students and Lecturers. https://doi.org/10.13140/RG.2.2.20710.09287/2.

Gisondi, M.A., Barber, R., Faust, J.S., Raja, A., Strehlow, M.C., Westafer, L.M. and Gottlieb, M. (2022) ‘A Deadly Infodemic: Social Media and the Power of COVID-19 Misinformation’, Journal of Medical Internet Research, 24(2), e35552. https://doi.org/10.2196/35552.

Gonsalves, D. (2023) ‘On ChatGPT: what promise remains for multiple choice assessment?’, Journal of Learning Development in Higher Education, Issue 27, https://doi.org/10.47408/jldhe.vi27.1009.

Gold, J. (2023) ‘Adobe offers copyright indemnification for Firefly AI-based image app users’, Computerworld, 8 June. Available at: https://www.computerworld.com/article/3699053/adobe-offers-copyright-indemnification-for-firefly-ai-based-image-app-users.html (Accessed: 12 July 2023).

Gupta, S. and Chen, Y. (2022) ‘Supporting Inclusive Learning Using Chatbots? A Chatbot-Led Interview Study’, Journal of Information Systems Education, 33(1), pp.98-108. Available at: https://aisel.aisnet.org/jise/vol33/iss1/11 (Accessed 1 August 2023).

Haensch, A., Ball, S., Herklotz, M. and Kreuter, F. (2023) Seeing ChatGPT Through Students’ Eyes: An Analysis of TikTok Data. Available at: https://arxiv.org/abs/2303.05349 (Accessed: 30 June 2023).

Haleem, A., Javaid, M. and Singh, R.P. (2022) 'An era of ChatGPT as a significant futuristic support tool: A study on features, abilities, and challenges', BenchCouncil Transactions on Benchmarks, Standards and Evaluations, 2(4). https://doi.org/10.1016/j.tbench.2023.100089.

Hartmann, J., Schwenzow, J. and Witte, M. (2023) The political ideology of conversational AI: Converging evidence on ChatGPT's pro-environmental, left-libertarian orientation. https://doi.org/10.48550/arXiv.2301.01768.

Heaven, W. D. (2023) 'ChatGPT is going to change education, not destroy it', MIT Technology Review. Available at: https://www.technologyreview.com/2023/04/06/1071059/chatgpt-change-not-destroy-education-openai/ (Accessed: 30 July 2023).

Heikkilä, M., (2023) ‘OpenAI’s hunger for data is coming back to bite it’, MIT Technology Review, (online) Available at: https://www.technologyreview.com/2023/04/19/1071789/openais-hunger-for-data-is-coming-back-to-bite-it/ (Accessed: 10 July 2023).

Hemsley, B., Power, E., and Given, F. (2023) ‘Will AI tech like ChatGPT improve inclusion for people with communication disability?’ The Conversation. https://theconversation.com/will-ai-tech-like-chatgptimprove-inclusion-for-people-with-communicationdisability-196481 (Accessed: 11 July 2023).

Intelligent.com, (2023) Nearly 1 in 3 College Students Have Used ChatGPT on Written Assignments. Available at: https://www.intelligent.com/nearly-1-in-3-college-students-have-used-chatgpt-on-written-assignments/ (Accessed: 10 July 2023).

Javaid, M., Haleem, A., Singh, R.P., Khan, S., and Khan, I.H. (2023) "Unlocking the opportunities through ChatGPT Tool towards ameliorating the education system." BenchCouncil Transactions on Benchmarks, Standards and Evaluations, 3(2), pp.100115. Available at: https://www.sciencedirect.com/science/article/pii/S2772485923000327#b23 (Accessed: 10 July 2023).

Karim, R. (2023) ‘ChatGPT: Old AI problems in a new guise, new problems in disguise’. Lens, 13 February. Available at: https://lens.monash.edu/@politics-society/2023/02/13/1385448/chatgpt-old-ai-problems-in-a-new-guise-new-problems-in-disguise (Accessed 26 March 2024).

Kasneci, E., Sessler, K., Küchemann, S., Bannert, M., Dementieva, D., Fischer, F., Gasser, U., Groh, G., et al. (2023) ‘ChatGPT for good? On opportunities and challenges of large language models for education’, Learning and Individual Differences, 103, p.102274. https://doi.org/10.1016/j.lindif.2023.102274.

Kaur, D. (2023) 'ChatGPT in Japan: concerns and issues', Tech Wire Asia. Available at: https://techwireasia.com/2023/06/after-italy-japan-has-its-eyes-on-chatgpt-over-data-privacy-concerns/ (Accessed: 2 August 2023).

Khowaja, S.A., Khuwaja, P., and Dev, K. (2023) ChatGPT Needs SPADE (Sustainability, PrivAcy, Digital divide, and Ethics) Evaluation: A Review. ArXiv. Available at: https://arxiv.org/pdf/2305.03123.pdf (Accessed: 2 August 2023).

Lancaster, T. (2023) ‘Artificial intelligence, text generation tools and ChatGPT – does digital watermarking offer a solution?’ International Journal for Educational Integrity. Available at: https://edintegrity.biomedcentral.com/articles/10.1007/s40979-023-00131-6 (Accessed: 2 August 2023).

Liang, W., Yuksekgonul, M., Mao, Y., Wu, E., and Zou, J. (2023) ‘GPT detectors are biased against non-native English writers’, Patterns. Available at: https://www.cell.com/patterns/fulltext/S2666-3899(23)00130-7 (Accessed: 12 July 2023).

Lim, W.M., Gunasekara, A., Pallant, J.L., Pallant, J.I., and Pechenkina, E. (2023) ‘Generative AI and the future of education: Ragnarök or reformation? A paradoxical perspective from management educators’, The International Journal of Management Education, 21(2), 100790. Available at: https://www.sciencedirect.com/science/article/pii/S1472811723000289 (Accessed: 09 July 2023).

Mills, A. (2023a) 'AI Text Generators: Sources to Stimulate Discussion Among Teachers', Google Docs. Available at: https://docs.google.com/document/d/1V1drRG1XlWTBrEwgGqd-cCySUB12JrcoamB5i16-Ezw/edit#heading=h.qljyuxlccr6 (Accessed: 12 July 2023).

McCallum, S. (2023) 'ChatGPT accessible again in Italy', BBC News. Available at: https://www.bbc.com/news/technology-65431914 (Accessed: 2 August 2023).

McMurtrie, B. (2023) 'How ChatGPT could help or hurt students with disabilities', The Chronicle of Higher Education. Available at: https://www.chronicle.com/article/how-chatgpt-could-help-or-hurt-students-with-disabilities (Accessed: 30 July 2023).

Mollick, E. (2022) 'ChatGPT Is a Tipping Point for AI', Harvard Business Review. Available at: https://hbr.org/2022/12/chatgpt-is-a-tipping-point-for-ai (Accessed: 24 June 2023).

Nikolic, S., Daniel, S., Haque, R., Belkina, M., Hassan, G.M., Grundy, S., Lyden, S., Neal, P., and Sandison, C. (2023) 'ChatGPT versus engineering education assessment: a multidisciplinary and multi-institutional benchmarking and analysis of this generative artificial intelligence tool to investigate assessment integrity', European Journal of Engineering Education, 48(4), pp. 559-614. https://doi.org/10.1080/03043797.2023.2213169.

O'Brien, M. (2023) Chatbots sometimes make things up. Is AI’s hallucination problem fixable? AP News. Available at: https://apnews.com/article/artificial-intelligence-hallucination-chatbots-chatgpt-falsehoods-ac4672c5b06e6f91050aa46ee731bcf4 (Accessed: 31 June 2023).

OpenAI (2023b) GPT-4. Available at: https://openai.com/research/gpt-4 (Accessed: 1 August 2023).

Rasul, T., Nair, S., Kalendra, D., Robin, M., Santini, F. de O., Ladeira, W. J., Sun, M., Day, et al. (2023) ‘The role of ChatGPT in higher education: Benefits, challenges, and future research directions’, Journal of Applied Learning and Teaching. 6(1). https://doi.org/10.37074/jalt.2023.6.1.29.

Rich, A.S. and Gureckis, T.M., (2019) ‘Lessons for artificial intelligence from the study of natural stupidity’, Nature Machine Intelligence, 1(4), pp.174-180. Available at: https://www.nature.com/articles/s42256-019-0038-z (Accessed: 13 July 2023).

Reuters. (2023) ChatGPT sets record for fastest-growing user base - analyst note. Reuters. Available at: https://www.reuters.com/technology/chatgpt-sets-record-fastest-growing-user-base-analyst-note-2023-02-01/ (Accessed: 15 June 2023).

Rudolph, J., Tan, S., and Tan, S. (2023a) ‘ChatGPT: Bullshit spewer or the end of traditional assessments in higher education?’, Journal of Applied Learning and Teaching. 6(1). https://doi.org/10.37074/jalt.2023.6.1.9.

Rudolph, J., Tan, S. and Tan, S. (2023b) ‘War of the chatbots: Bard, Bing Chat, ChatGPT, Ernie and beyond. The new AI gold rush and its impact on higher education’, ED-TECH Reviews. 6(1). https://doi.org/10.37074/jalt.2023.6.1.23.

Sabzalieva, E. and Valentini, A. (2023) 'ChatGPT and Artificial Intelligence in higher education: Quick start guide', UNESCO International Institute for Higher Education in Latin America and the Caribbean (IESALC). Available at: https://www.iesalc.unesco.org/wp-content/uploads/2023/04/ChatGPT-and-Artificial-Intelligence-in-higher-education-Quick-Start-guide_EN_FINAL.pdf (Accessed: 24 June 2023).

Sadasivan, V.S., Kumar, A., Balasubramanian, S., Wang, W. and Feizi, S., (2023) Can AI-Generated Text be Reliably Detected? https://doi.org/10.48550/arXiv.2303.11156.

Sansom, C. (2023) Sustaining Innovation in Research: Innovations and Issues around Generative AI. University of London. Available at: https://www.london.ac.uk/centre-online-distance-education/blog/generative-ai (Accessed: 29 June 2023).

Smith, D. P. and Francis, N. J. (2023) Generative AI in assessment. Available at: https://network.febs.org/posts/generative-ai-in-assessment (Accessed: 12 September 2023).

Stokel-Walker, C., (2022) ‘AI bot ChatGPT writes smart essays — should professors worry?’ Nature. Available at: https://www.nature.com/articles/d41586-022-04397-7 (Accessed 11 July 2023).

Stokel-Walker, C., Van Noorden, R. (2023) ‘What ChatGPT and generative AI mean for science’, Nature. Available at: https://pubmed.ncbi.nlm.nih.gov/36747115/ (Accessed 12 July 2023).

Strowel, A. (2023) ‘ChatGPT and Generative AI Tools: Theft of Intellectual Labor?’, International Review of Intellectual Property and Competition Law, 54, pp.491–494.

Sullivan, M., Kelly, A., and McLaughlan, P. (2023) ‘ChatGPT in higher education: Considerations for academic integrity and student learning’, Journal of Applied Learning and Teaching, 6(1). https://doi.org/10.37074/jalt.2023.6.1.17.

Tlili, A., Shehata, B., Adarkwah, M.A., Bozkurt, A., Hickey, D.T., Huang, R., and Agyemang, B. (2023) ‘What if the devil is my guardian angel: ChatGPT as a case study of using chatbots in education’, Smart Learning Environments, 10(1), p.15. https://doi.org/10.1186/s40561-023-00237-x.

Tredinnick, L., and Laybats, C. (2023) ‘The dangers of generative artificial intelligence’, Business Information Review, 40(2). https://doi.org/10.1177/02663821231183756.

van Dis, E.A.M., Bollen, J., Zuidema, W., van Rooij, R., and Bockting, C.L. (2023) ‘ChatGPT: five priorities for research’, Nature, 614, pp.224-226. Available at: https://doi.org/10.1038/d41586-023-00288-7 (Accessed: 13 June 2023).

Ventayen, R.J.M. (2023) 'OpenAI ChatGPT Generated Results: Similarity Index of Artificial Intelligence-Based Contents', Advances in Intelligent Systems and Computing. Available at: https://papers.ssrn.com/sol3/papers.cfm?abstract_id=4332664 (Accessed: 9 July 2023).

Wang, T., Lund, B.D., Marengo, A., Pagano, A., Mannuru, N.R., Teel, Z.A. and Pange, J. (2023) ‘Exploring the Potential Impact of Artificial Intelligence (AI) on International Students in Higher Education: Generative AI, Chatbots, Analytics, and International Student Success’, Applied Sciences, 13(11), 6716. https://doi.org/10.3390/app13116716.

Weinberger, D. (2019) ‘How machine learning pushes us to define fairness’, Harvard Business Review, 11, pp.2-6.

Wiggers, K. (2023) 'OpenAI connects ChatGPT to the internet', TechCrunch, 23 March. Available at: https://techcrunch.com/2023/03/23/openai-connects-chatgpt-to-the-internet/ (Accessed: 5 July 2023).

Wu, X., Duan, R. and Ni, J. (2023) ‘Unveiling Security, Privacy, and Ethical Concerns of ChatGPT’, Department of Electrical and Computer Engineering, Queen’s University, Kingston, Canada. Available at: https://arxiv.org/pdf/2307.14192.pdf (Accessed 3 August 2023).

Yu, H., and Guo, Y. (2023) ‘Generative AI in Education: Current Status and Future Prospects’, Frontiers in Education. https://doi.org/10.3389/feduc.2023.1183162.

Zou, A., Wang, Z., Kolter, J.Z. and Fredrikson, M. (2023) Universal and Transferable Adversarial Attacks on Aligned Language Models. https://doi.org/10.48550/arXiv.2307.15043.

Downloads

Published

27-03-2024

How to Cite

Bobula, M. (2024) “Generative artificial intelligence (AI) in higher education: a comprehensive review of challenges, opportunities, and implications”, Journal of Learning Development in Higher Education, (30). doi: 10.47408/jldhe.vi30.1137.

Issue

Section

Papers