Hiring Software Engineers
Hiring software engineers is the process of defining the work, gathering job-related evidence from candidates, and making a documented selection decision. A sound process tests what the role needs while giving candidates a consistent chance to show it.
itEngineering leadership and delivery management | OpenSkills.info
Course pathWalk it in order
Look it upDip in anytime
Go furtherLeaves this page
Don't Panic
Don't Panic — Hiring Software Engineers
The corridor version: hiring an engineer is a prediction you make from a small sample. You are guessing how someone will handle real work after they join, using a resume, a few conversations, and a coding task. This course is about making that guess traceable instead of lucky.
Before anyone wrote this down, a hiring loop was usually a favorite puzzle, a whiteboard, and a debrief where the most confident voice won. Adding more interviews felt like rigor. Mostly it added cost and a longer line of tired candidates. The fix is not a bigger loop. It is a chain where each link connects to the next: a job outcome leads to a task, the task to a competency, the competency to an assessment, the assessment to a recorded observation, the observation to a rating, and the rating to a documented decision. When a hire goes wrong, you look for the broken link rather than bolting on another round.
Three ideas carry most of the weight.
Start with a job analysis. Name the outcomes the role owns and the observable tasks behind them, then separate what a person needs on the first day from what your team will teach later. Testing a tool you plan to train someone on rejects people for the wrong reason.
Then build an evidence plan. Every critical competency maps to at least one assessment and a rating rule you write before meeting anyone. A fashionable coding problem is weak evidence when it does not represent the work. Use a second source for the competencies you cannot afford to get wrong, and do not run the same test twice under different names.
Then structure each interview. Comparable candidates get the same core questions in the same order, scored on the same anchored scale, and each interviewer records evidence and rates independently before the group talks. "Strong candidate" is a conclusion. "Found the race condition and wrote a test that reproduces it" is evidence someone else can check.
Here is the part that surprises people. Structure sounds rigid, as though it means reading a script and ignoring the answer. It is the opposite. Planned probes still let you follow an interesting thread; what structure removes is the easier path for one candidate and the rating criteria invented halfway through a conversation. The process does not take judgment out of hiring. It leaves a trail you can inspect.
One genuinely annoying fact: none of this makes hiring certain. Selection evidence is always incomplete, the work changes after you write the role, and onboarding matters. What you get is a process you can review and repair.
For the whole picture, read the Intro, with the Slides as the compressed map and the Cheatsheet for the interview-kit checklist, the rubric anchors, and the funnel-review table. Field Notes covers what teams get wrong once the diagram makes sense: how noisy a single interview really is, why watched coding measures nerves as much as skill, and which selection-validity numbers quietly moved. This course is a process model, not legal advice, so involve your HR, accessibility, privacy, and legal specialists before you change how you select.
Where this skill leads
Relevant careers
See how this topic contributes to broader role-level skill maps.
Sources
- https://www.opm.gov/policy-data-oversight/assessment-and-selection/job-analysis/
Supports
- Job analysis as the foundation for assessment and selection decisions
- Links among job tasks, competencies, and selection procedures
- https://www.opm.gov/frequently-asked-questions/assessment-policy-faq/job-analysis/are-all-competencies-rated-as-important-to-job-performance-appropriate-for-selection-purposes/
Supports
- Distinction between competencies required on entry and those learned after selection
- Selection focus on competencies needed on the first day
- https://www.opm.gov/policy-data-oversight/assessment-and-selection/assessment-strategy/
Supports
- Assessment strategy beginning with critical competencies from job analysis
- Standardized and documented assessment administration
- Job relevance, validity evidence, applicant reactions, and realistic job previews
- https://www.opm.gov/policy-data-oversight/assessment-and-selection/structured-interviews
Supports
- Definition and characteristics of structured interviews
- Predetermined questions, common order, and shared rating standards
- https://www.opm.gov/policy-data-oversight/assessment-and-selection/structured-interviews/guide/
Supports
- Development of questions, probes, rating scales, and interview documentation
- Interviewer training, behavioral notes, and defensible ratings
- Independent panel ratings before discussion and consensus
- https://www.eeoc.gov/laws/guidance/employment-tests-and-selection-procedures
Supports
- Tests and selection procedures under United States federal anti-discrimination laws
- Job relevance, disparate impact, disability, and accommodation considerations
- https://www.eeoc.gov/laws/guidance/questions-and-answers-clarify-and-provide-common-interpretation-uniform-guidelines
Supports
- Total selection process, adverse impact, and validation concepts
- Content validity based on important work behaviors and job analysis
- Consideration of alternative selection procedures
- https://github.blog/developer-skills/career-growth/how-github-does-take-home-technical-interviews/
Supports
- GitHub's use of work-resembling pull-request tasks, candidate tools, and time limits
- Automated tests, anonymized review, rubrics, and scorecards in its described process
- https://github.com/sindresorhus/awesome
Supports
- Starting point for awesome-list discovery
- https://github.com/engineering-management/awesome-engineering-management
Supports
- Discovery of the Manager's Handbook and Carta hiring resources
- Discovery of the related engineering-management resource collection
- https://github.com/charlax/engineering-management
Supports
- Discovery of GitHub's take-home case study and the Guardian coding-exercises project
- Curated hiring sections for engineering managers
- https://themanagershandbook.com/hiring-and-onboarding/hiring-101
Supports
- Handbook navigation across role proposal, sourcing, interviews, closing, and onboarding
- Its standardized hiring artifacts and interview guidance
- https://github.com/guardian/coding-exercises
Supports
- Open coding exercises used in the Guardian engineering recruitment process
- Candidate information and in-person and remote interviewer process materials
- https://carta.com/blog/how-to-hire/
Supports
- Carta's stated hiring principles and heuristics
- Context for comparing practitioner judgment with structured assessment guidance
- https://interviewing.io/blog/technical-interview-performance-is-kind-of-arbitrary-heres-the-data
Supports
- Roughly 25 percent of candidates scoring consistently across repeated technical interviews
- Measured variability of individual interview performance underpinning the variance card
- https://par.nsf.gov/servlets/purl/10196170
Supports
- Randomized study where watched whiteboard problem-solving cut measured performance by more than half
- Observation as a treatment effect rather than a neutral window onto skill
- https://pubmed.ncbi.nlm.nih.gov/34968080/
Supports
- 2022 re-analysis finding systematic range-restriction overcorrection inflating validity estimates
- Revised validity estimates with structured interviews top-ranked at about .42 and cognitive ability about .31
- https://www.officialasvab.com/recruiters/history-of-military-testing/
Supports
- 1917 development of the Army Alpha and Army Beta group tests for recruit screening
- https://www.eeoc.gov/statutes/title-vii-civil-rights-act-1964
Supports
- Title VII prohibiting employment discrimination on race, color, religion, sex, or national origin
- https://www.law.cornell.edu/supremecourt/text/401/424
Supports
- Griggs v. Duke Power disparate-impact holding and the employer's job-relatedness burden
- https://www.ecfr.gov/current/title-29/subtitle-B/chapter-XIV/part-1607
Supports
- Joint adoption of the Uniform Guidelines on August 25, 1978 by four federal agencies
- https://doi.apa.org/doi/10.1037/0033-2909.124.2.262
Supports
- Schmidt and Hunter 1998 meta-analysis of selection method validity
- https://openlibrary.org/books/OL25874654M.json
Supports
- April 7, 2015 publication date of Laszlo Bock's Work Rules!
- https://www.eeoc.gov/laws/guidance/select-issues-assessing-adverse-impact-software-algorithms-and-artificial
Supports
- May 18, 2023 EEOC technical assistance on adverse impact and AI in selection
- https://www.nyc.gov/site/dca/about/automated-employment-decision-tools.page
Supports
- July 5, 2023 start of New York City enforcement of automated employment decision tool rules
