Prototype of a Large Language Model-Based Interviewer: Design, Implementation, and Evaluation
The development of artificial intelligence agents based on Large Language Models (LLMs) represents a major milestone in the automation of technical interview processes. Modern LLMs enable the simulation of realistic communication between a candidate and an interviewer, during which the candidate’s responses are analyzed, technical skills evaluated, and feedback formulated according to predefined criteria.
This paper presents the implementation and analysis of an AI agent that uses LLMs to conduct interviews with candidates applying for software engineering positions. A well-designed system of this kind enables reliable assessment of candidate performance through the analysis of guided conversation and interaction within a programming work environment.