GPT-4 vs. GPT-3.5 AS CODING ASSISTANTS
Lefteris Moussiades, George Zografos, George A. Papakostas · Research Square · 2024
Abstract Large Language Models are not limited to understanding and producing natural language. Instead, they do equally well in understanding and generating source code in various programming languages. At the time of writing, GPT-4 was considered the most potent large language model from OpenAI. This paper compares GPT-4 with its immediate ancestor, GPT-3.5, as coding assistants. More specifically, we have constructed appropriate tests to check whether the two systems can a) answer typical questions that can arise during code development, b) generate reliable code in response to user requirements, and c) contribute to code debugging. The test results for both models are impressive. However, the performance of GPT-4 is outstanding and signals an increase in the productivity of programmers and the reorganization of software development procedures based on these new tools.