TC014: Structured Interviews

1. Overview

Structured interviews represent a systematic and standardized approach to interviewing candidates for a role or gathering data for research. Unlike unstructured or semi-structured interviews, where questions can vary between candidates and the conversation can flow organically, a structured interview follows a predefined script. Every candidate is asked the same set of questions in the same order, and their responses are evaluated against a consistent scoring rubric. This method is designed to increase the reliability and validity of the interview process, ensuring that each candidate is assessed on the same criteria. The core purpose of this pattern is to minimize bias and subjectivity, leading to more objective and evidence-based decisions.

The primary problem that structured interviews solve in a business or startup context is the inherent inconsistency and unfairness of traditional, unstructured interviews. Unstructured interviews are highly susceptible to interviewer bias, such as the halo/horn effect, confirmation bias, and affinity bias, where interviewers may favor candidates who are similar to them. This can lead to poor hiring decisions, a lack of diversity, and potential legal challenges. By standardizing the questions and evaluation criteria, structured interviews create a level playing field for all candidates, ensuring that the selection process is based on job-relevant skills and competencies rather than on an interviewer’s gut feeling or personal preferences. This pattern is particularly valuable for organizations committed to building a meritocratic and inclusive culture.

The concept of the structured interview has its roots in industrial-organizational psychology and was developed to improve the predictive validity of interviews in hiring. While the idea of standardizing questions has been around for decades, it was popularized by researchers who demonstrated its superiority over unstructured interviews in predicting job performance. In the context of commons-aligned value creation, structured interviews are a powerful tool for promoting fairness, transparency, and equal opportunity. By ensuring that everyone is evaluated on the same terms, this pattern helps to build trust and legitimacy within a community or organization. It supports the creation of a commons of opportunity, where access to roles and resources is based on merit and contribution, rather than on personal connections or arbitrary judgments.

2. Core Principles

1. Standardization: The cornerstone of the structured interview is the uniform application of the process. All candidates are asked the identical set of questions in the same sequence, ensuring a consistent experience and a fair basis for comparison.

2. Job-Relevance: The questions are not arbitrary; they are meticulously designed to assess the specific knowledge, skills, abilities, and other characteristics (KSAOs) that are critical for successful performance in the role. This is typically achieved through a thorough job analysis.

3. Systematic Scoring: A predefined scoring rubric is used to evaluate candidate responses. This rubric provides clear criteria for what constitutes an excellent, good, average, or poor answer, which helps to quantify the assessment and reduce subjective interpretation.

4. Focus on Behavior and Situations: The questions are often behavioral or situational in nature. Behavioral questions ask candidates to describe how they have handled specific situations in the past, while situational questions present hypothetical scenarios and ask how they would respond. This is based on the premise that past behavior and intended future behavior are good predictors of future performance.

5. Interviewer Training: To ensure the process is implemented correctly and consistently, all interviewers receive training on how to conduct the interview, ask the questions, and use the scoring rubric. This minimizes variations in how the interview is administered.

6. Objectivity and Fairness: The entire process is designed to be as objective and fair as possible. By minimizing the influence of interviewer biases, structured interviews aim to make decisions based on a candidate’s actual qualifications and potential.

3. Key Practices

1. Conduct a Thorough Job Analysis: Before creating the interview questions, perform a detailed analysis of the job to identify the essential duties, responsibilities, and the KSAOs required to perform them effectively.

2. Develop Behavioral and Situational Questions: Based on the job analysis, create a set of open-ended questions that probe for the most critical competencies. For example, for a project management role, you might ask, “Tell me about a time a project you were managing was behind schedule. What did you do?”

3. Create a Standardized Scoring Guide: For each question, develop a scoring rubric with benchmark answers that define different levels of performance (e.g., a 5-point scale from “unacceptable” to “excellent”). This guide should be used by all interviewers to rate the candidates’ responses.

4. Establish an Interview Panel: Whenever possible, use a panel of two or more interviewers. This helps to average out individual biases and provides a more comprehensive assessment of the candidate.

5. Train the Interviewers: All interviewers must be trained on the principles of structured interviewing, the specific questions to be asked, and how to use the scoring guide. This ensures that everyone is on the same page and that the process is applied consistently.

6. Conduct the Interviews Consistently: During the interviews, stick to the script. Ask all candidates the same questions in the same order. Avoid follow-up questions that are not part of the standardized process, unless it is to clarify a candidate’s response.

7. Score and Deliberate: After each interview, the interviewers should independently score the candidate’s responses using the scoring guide. Then, the panel should meet to discuss their ratings, resolve any major discrepancies, and arrive at a consensus score.

8. Make Data-Driven Decisions: Use the final scores as a primary input for making the hiring decision. While other factors may be considered, the data from the structured interview should carry significant weight.

4. Implementation

Implementing structured interviews requires a deliberate and systematic effort, but the long-term benefits in terms of hiring quality and fairness are substantial. The first step is to secure buy-in from leadership and hiring managers, as it represents a shift from traditional, more intuitive hiring practices. Once there is commitment, the process begins with a rigorous job analysis to identify the core competencies for the role. This analysis can involve reviewing job descriptions, interviewing high-performing incumbents, and discussing the role’s requirements with stakeholders. The output of this analysis is a clear set of KSAOs that will form the basis for the interview questions.

With the competencies defined, the next step is to develop the interview questions and the scoring rubric. This is a critical and often time-consuming part of the process. The questions should be carefully crafted to elicit behavioral examples or situational judgments that are directly relevant to the competencies. The scoring rubric should provide clear, unambiguous descriptions of what a high-quality and low-quality answer looks like. Once the interview protocol is developed, it is essential to train the interviewers. This training should cover the rationale behind structured interviews, how to ask the questions, how to avoid common biases, and how to use the scoring rubric consistently. A great real-world example is Google, which has extensively used structured interviews to improve its hiring process, focusing on cognitive ability, leadership, and other job-related skills.

When conducting the interviews, it is crucial to maintain the integrity of the process. All candidates should be treated in the same professional and respectful manner. After the interviews are completed, the scoring and deliberation process should be conducted in a timely and structured way. The final hiring decision should be based on the evidence gathered during the interviews, as captured in the scores, rather than on gut feelings or personal preferences. By following this systematic approach, organizations can significantly improve the quality of their hires and build a more diverse and capable workforce.

5. 7 Pillars Assessment

6. When to Use

• When hiring for roles where the cost of a bad hire is high.
• When an organization is committed to improving diversity and inclusion.
• When you need to hire a large number of people for the same role and need to ensure consistency.
• When you want to reduce the influence of unconscious bias in the hiring process.
• In any situation where a fair, transparent, and defensible selection process is required.
• When you need to compare candidates objectively based on job-relevant criteria.

7. Anti-Patterns and Gotchas

• Poorly designed questions: If the questions are not based on a thorough job analysis, they will not be effective at identifying the best candidates.
• Lack of interviewer training: Untrained interviewers may not follow the protocol correctly, which can undermine the entire process.
• Inflexibility: While standardization is key, interviewers should be trained to handle situations where a candidate may need a question to be clarified. However, this should be done in a way that does not introduce bias.
• Over-reliance on scores: The scores are an important data point, but they should not be the only factor in the hiring decision. Other information, such as references and work samples, should also be considered.
• Creating a sterile experience: While structured, the interview should still be a positive and engaging experience for the candidate. Interviewers should be trained to build rapport and create a comfortable atmosphere.
• Failing to get buy-in: If hiring managers are not convinced of the value of structured interviews, they may resist the process or not take it seriously, which will limit its effectiveness.

8. References

1. What Is a Structured Interview? With Definition and Examples - Indeed

2. [Structured Interview

   Definition, Guide & Examples - Scribbr](https://www.scribbr.com/methodology/structured-interview/)

3. Structured Interviews - OPM.gov

4. [The Complete Guide to Structured Interviews

   Criteria Corp](https://www.criteriacorp.com/resources/complete-guide-to-structured-interviews)

5. Structured vs. Unstructured Interview: Improving Accuracy - McGill University