Generative AI tools are rapidly transforming software engineering. MITRE conducted preliminary development tests comparing the abilities of multiple Generative AI tools to a human developer. This paper contains MITRE’s findings and recommendations.
The rapid rise of Generative Artificial Intelligence (AI) tools is altering the software engineering profession. These tools interpret user requests, referred to as prompts, and analyze them against large volumes of training data to generate responses. Software engineers are using Generative AI tools today to support work across the lifecycle.
In the fall of 2023, MITRE conducted preliminary software development tests comparing the abilities of multiple Generative AI tools to a human developer. This paper contains MITRE’s findings and recommendations for effectively using Generative AI tools to develop software.
MITRE understands the growing power of Generative AI tools and believes they are an important part of the future of software engineering. While our work shows the potential for software developers to reduce the time required to complete discrete tasks, it is incumbent upon software developers to learn how to use Generative AI tools effectively and safely.