The Future of Chatbots: Survey on Generative Pretrained Models, Ernie, and Gemini
Abhishek Raut, Jayashree Katti · 2024
The evolution of chatbots from rule-based, retrieval-based, contextual systems, to hybrid and generative AIpowered models. It aimsto solve complex natural language processing and task-specific challenges. The finding explores innovative self-attention mechanisms in the Generative Pretrained Transformer (GPT). The GPT model training and fine-tuning methods include discriminative fine-tuning, zeroshot and few-shot learning, parallel processing, and reinforcement learning with human feedback. Revolutionary multimodal AI models like GPT-4 (Open-AI), Ernie (Baidu), and Gemini (Google). The study discovers the advantages and limitations of chatbots.