Studies [1] show that a work sample test is the best predictor of candidate performance on the job, which is why many software engineering teams use take-home tests as one step in their hiring process. But designing an effective test is difficult and time-consuming. For example, candidates are reluctant to complete tests that are too long or not engaging enough. But make them too short and teams won’t get the signal they need for a proper evaluation.<p>To encourage more thoughtful test design (and hopefully save future candidates from the worst offenders), my team compiled the <i>largest library of non-“whiteboard” take-home tests</i> that real engineering teams have used. You’ll find the challenges that Stripe and Microsoft gave to their full-stack candidates, front-end tests from Tailwind and Rivian, and back-end ones from Basecamp and Revolut. Whether you’re looking to evaluate an Android, DevOps, or Data Science candidate, a bootcamp grad, or senior engineer, we found a few options for each.<p>Having built 20+ tests ourselves, we also rated the design of each test. The criteria for a 5-star rating:<p>1. Tests for skills highly relevant to those required for the position<p>2. Includes a well-written description of the prompt and even motivation for using a take-home test<p>3. Sets clear expectations for candidates (e.g. time requirements, evaluation criteria, submission details)<p>4. Asks for a reasonable time commitment from candidates (<4 hours)<p>A few notes:
- We found most of these test prompts in public GitHub repos, usually owned by the hiring team but occasionally in the candidate-owned submission. We sifted through hundreds of tests and filtered out those overly focused on algorithms (aka LeetCode), leaving us with 142 tests in the library.<p>- The larger and more recognizable companies didn’t always have the best tests. Some of the most interesting prompts we found were from smaller teams (e.g. YC startups). This shouldn’t be surprising. Startups need to design candidate-friendly hiring experiences to compete for talent against more established players.<p>- There were common themes among the tests we found. For example, front-end candidates were often given a Figma design + content feed to implement, while back-end candidates had to implement an API given a set of requirements. Data scientists were usually given a data set to clean, analyze, and submit a Jupyter notebook with their findings.<p>- We’ll continue to update this library and add descriptions of each test so it’s easier to compare.<p>Have feedback, or another take-home test we should add? We’d love to hear from you!<p>[1] The Validity and Utility of Selection Methods in Personnel Psychology (<a href="https://www.researchgate.net/publication/232564809_The_Validity_and_Utility_of_Selection_Methods_in_Personnel_Psychology" rel="nofollow">https://www.researchgate.net/publication/232564809_The_Valid...</a>)