Use of ChatGPT and its implications in the academic and scientific community: failures, misuse and challenges
DOI:
https://doi.org/10.18779/ingenio.v8i2.1091Keywords:
Artificial intelligence, digital platform, conversational assistant, machine learning algorithmsAbstract
This article systematically analyzes the main advantages and limitations of using conversational artificial intelligence (AI), specifically ChatGPT, as a support tool for essay writing in academic and scientific contexts. Additionally, selected problems in mathematics and science were addressed to evaluate the effectiveness of this platform. To this end, a systematic case study was designed and implemented, through which data generated by the chatbot were collected and analyzed. As part of the study, essays were written on six different topics, with the introductory sections produced using ChatGPT. In parallel, six mathematical problems were solved, covering topics such as integrals, Z-transform, Laplace transform, and ordinary differential equations. Furthermore, the model was prompted to provide the definition and calculation method for the fracture toughness of materials. The data analysis led to the conclusion that ChatGPT is capable of generating grammatically correct and syntactically coherent texts within a short time frame. However, the generated introductions were limited in content, relying mostly on general information and lacking critical argumentation. Regarding the mathematical case study, it was observed that, in its current state, the platform exhibits significant limitations in solving complex equations, highlighting the need for substantial improvements to enhance ChatGPT's performance in mathematical applications.
Downloads
References
B. Gordijn y H. T. Have, "ChatGPT: evolution or revolution?," Med. Health Care Philos., vol. 26, pp. 1-2, 2023. [Online]. Available: https://doi.org/10.1007/s11019-023-10136-0
J. Dahmen, M. Kayaalp, M. Ollivier y A. Pareek, M. T. Hirschmann, J. Karlsson, P. W. Winkler, “Artificial intelligence bot ChatGPT in medical research: the potential game changer as a double-edged sword”, Knee Surg. Sports Trau, vol. 31, no. 4, pp. 1187–1189, 2023. [Online]. Available: https://doi.org/10.1007/s00167-023-07355-6
G. Grimaldi y B. Ehrler, "AI et al.: Machines Are About to Change Scientific Publishing Forever", ACS Energy Letters, vol. 8, no. 1, pp. 878-880, 2023. [Online]. Available: https://doi.org/10.1021/acsenergylett.2c02828
M. Dowling y B. Lucey, "ChatGPT for (Finance) research: The Bananarama Conjecture", Finance Res. Lett., vol. 53, pp. 103662-103668, 2023. [Online]. Available: https://doi.org/10.1016/j.frl.2023.103662
J. Chatterjee y N. Dethlefs, "This new conversational AI model can be your friend, philosopher, and guide ... and even your worst enemy," Patterns, vol. 4, no.1, pp. 100676-100678, 2023. [Online]. Available: https://doi.org/10.1016/j.patter.2022.100676
Welcome to the AI future?. Nat Astron, vol. 7, no. 1, pp. 1-4, 2023. [Online]. Available: https://doi.org/10.1038/s41550-023-01891-4
The AI writing on the wall. Nat Mach Intell, vol. 5, no. 1, pp. 1-5, 2023. [Online]. Available: https://doi.org/10.1038/s42256-023-00613-9
P. A. Rospigliosi, "Artificial intelligence in teaching and learning: what questions should we ask of ChatGPT?", Interactive Learning Environments, vol. 31, no. 1, pp. 1-3, 2023. [Online]. Available: https://doi.org/10.1080/10494820.2023.2180191
C. Stokel-Walker, "AI bot ChatGPT writes smart essays—Should professors worry?”, Nature, pp. 1-4, 2022. [Online]. Available: https://doi.org/10.1038/d41586-022-04397-7
S. Hammerstein, C. König, T. Dreisörner y A. Frey, "Effects of COVID-19-Related School Closures on Student Achievement-A Systematic Review", Front. Psychol., vol. 12, pp.1-10. 2021. [Online]. Available: https://doi.org/10.3389/fpsyg.2021.746289
S. Irais y A. Navarrete, "The ChatGPT artificial intelligence chat, language, and text generation tool has sparked concern and interest from the education sector”. [Online]. Available: https://goo.su/W5FUYx.
N. L. Borja-Hart, C. A. Spivey y C. M. George, "Use of virtual patient software to assess student confidence and ability in communication skills and virtual patient impression: A mixed-methods approach", Currents in Pharmacy Teaching and Learning, vol. 11, no. 7, pp. 710-718, 2019. [Online]. Available: https://doi:10.1016/j.cptl.2019.03.009
K. K. Fitzpatrick, A. Darcy y M. Vierhile, "Delivering Cognitive Behavior Therapy to Young Adults with Symptoms of Depression and Anxiety Using a Fully Automated Conversational Agent (Woebot): A Randomized Controlled Trial", JMIR Ment Health, vol. 4, no. 2, pp. e19-e23, 2017. [Online]. Available: https://doi:10.2196/mental.7785
E. Agyuz y M. Acikgoz, "Applications of Z-transform to Some Elemantary Functions in q- and (p,q)-Calculus", Turkish Journal of Analysis and Number Theory, vol. 4, no. 6, pp. 164-167, 2016. [Online]. Available: https://doi:10.12691/tjant-4-6-3
A. C. Grove, An Introduction to the Laplace Transform and the Z Transform. Salisbury, Wiltshire, UK, Prentice Hall, 1991.
W. J. Palm, System Dynamics. New York, USA, McGraw-Hill Higher Education, 2005.
D. G. Zill, A First Course in Differential Equations with Modeling Applications. Boston, MA, USA, Cengage Learning, 2017.
M. Alshater, "Exploring the Role of Artificial Intelligence in Enhancing Academic Performance: A Case Study of ChatGPT", 2022. [Online]. Available: http://dx.doi.org/10.2139/ssrn.4312358
S. O’Connor and ChatGpt, "Open artificial intelligence platforms in nursing education: Tools for academic progress or abuse?", Nurse Education in Practice, vol. 66, pp. 103537-103542, 2023. [Online]. Available: https://doi:10.1016/j.nepr.2022.103537
Published
How to Cite
Issue
Section
License
Copyright (c) 2025 Wilian J. Pech-Rodríguez, Eddie N. Armendáriz-Mireles, Carlos A. Calles-Arriaga, Enrique Rocha-Rangel
This work is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License.
Licensing Agreement
This journal provides free access to its content through its website following the principle that making research available free of charge to the public supports a larger exchange of global knowledge.
Web content of the journal is distributed under a Attribution-NonCommercial-ShareAlike 4.0 International.
Authors may adopt other non-exclusive license agreements for the distribution of the version of the published work, provided that the initial publication in this journal is indicated. Authors are allowed and recommended to disseminate their work through the internet before and during the submission process, which can produce interesting exchanges and increase citations of the published work.
