Analysing Concerns and Expressions of Using ChatGPT on Social Media and Educational Platform: An Application of Natural Language Processing and Machine Learning
Farhana Bina · International Journal of Data Science and Analysis · 2025
The advancement in Artificial Intelligence technology revolutionizes new opportunities and challenges, particularly with large language model ChatGPT, in various domains, especially in the educational platform. This research endeavors a comprehensive analysis to explore the concerns and expressions associated with this AI tool on the social media platform X and in academic contexts. Two distinct datasets, comprising X data and survey responses from academics, were utilized to achieve the objectives. This research examines the valuable concerns regarding ChatGPT among X users on social media platform. To implement the Natural Language Processing (NLP) techniques which included Sentiment Analysis and Topic Modeling using Latent Dirichlet Analysis (LDA), the study aimed to identify the significant insights expressed by the social media users. The analysis obtained that, most frequent discussed topic was “ChatGPT”. The majority of discussions among the X users were positive in sentiment (49%), focusing on the utility of ChatGPT. Comparatively, negative discussions (47%) were also expressed by the users (47%) about students’ cheating in exams, and the generation of inaccurate information, which could affect students’ learning skills, and their critical thinking. Furthermore, approximately 27% of the discussions were expressed neutral sentiment regarding the generation of contents by ChatGPT. Various machine learning models were implemented to predict the classification of sentiment labels correctly. The Random Forest model performed well to classify all the sentiment labels correctly compared to others with highest accuracy of 62%. This research also unveiled the academics’ opinion in the context of education. A case study was conducted among the academics, where approximately 59% reported using ChatGPT for academic purposes and academics (24%) use this tool occasionally. In terms of its usefulness, 32% academics consider it is as useful, especially for generating writing contents. Additionally, 29% of them believed that this tool primarily improves students’ language and writing skills but they also expressed the concerns about overreliance potentially impacting their critical thinking and violating academic integrity. The major concerned keywords for academics include “research”, “accuracy of information”, and “critical thinking”, while for students, “academic integrity”, “critical thinking”, “risk”, “copy-paste”, and “creativity skills”. The majority of the sentiments regarding the concerns were negative for students (38%), and minority for academics (28%). Overall, academics expressed positive sentiments about the utility of using ChatGPT. This research highlights these findings and recommends further exploration of using this tool in educational practices with a focus on the identified concerns to guide future implementation.