CodeVue is Hirevue’s Engineering solution that allows you to easily assess how well a candidate can solve problems using code. CodeVue helps interview for roles like developers and engineers.
Hirevue currently supports the following languages with CodeVue:
- Bash
- C
- C++
- C# 8.0
- C# 9.0
- Clojure
- Go
- Haskell 8
- Haskell 9
- Java
- JavaScript
- Kotlin
- MS Powershell
- Objective-C
- OCaml
- Perl
- PHP
- Python 2
- Python 3
- R 3.6
- R 4.1
- Ruby
- Rust(June 23)
- Scala 2
- Scala 3
- Swift
There are two parts to CodeVue: On Demand Coding Challenges and Live interview with Live Coding:
On Demand Coding Challenges: Presents the candidate with a programming challenge and allows them to code, test, and submit their solution.
For even more exhaustive testing of a specific language, you can also use the multiple choice or essay question functionalities in Hirevue.
Live interview with Live Coding: Allows the candidate and interviewer(s) to see a common text editor during the interview.
Live Use case: The interviewer might enter the beginning of a block of code or ask the candidate to begin writing according to specific instructions. While the candidate types, interviewers can see all their keystrokes and can ask questions or guide the candidate interactively.
Please note: Candidates will not be able to use a smartphone or tablet to complete an interview with CodeVue questions.
Scoring and Tests
Each coding challenge has a number of tests (between 5 and 15). Within the Hirevue system, a “test” is defined as an input and output pair. The input is the value we pass into the candidate’s code and the output is the value we expect to be returned.
Tests are pass or fail only. A test passes if the output of the candidate’s code is an exact match to the expected output for the test. We always show one or two tests to the candidate as part of the challenge. This helps the candidate make sure they understand what is being asked. We also run private tests that are hidden from the candidate’s view which help hiring managers validate the candidate’s understanding of programming logic and handling of edge and error cases.
The accuracy score is calculated as we compare the candidate’s output to the expected output for each test. The percent of the total tests that pass determines the candidate’s score. For example, if a challenge has 12 tests and the candidate’s solution passes 9 of them, then their score will be 75 percent.
Question Bank
The Question Bank has easy, medium, and hard level questions available to use. The Question Bank is available when you create a position, and it contains a variety of useful CodeVue questions ready for the interview.
Best practices
After the CodeVue question, create a video question and ask how the candidate solved the problem/why they solved it that way. This is a great way to guarantee the candidate knows how to solve the code and it shows their communication skills.
Always verify that you can solve the problem to prevent giving unsolvable codes to candidates. Even if you choose multiple languages for the question, you only need to solve the problem in one of the languages.
As a general guideline, the expected completion time for each respective level of coding challenge is listed below:
- Easy: 15-25 minutes
- Medium: 20-40 minutes
- Hard: 30-90 minutes
Please note: For both timed and untimed questions, you will be able to see how long the candidate took to answer the question.
For a better candidate experience, we recommend structuring the Interview Setup so the OnDemand experience takes an hour or less. If you want statistics on completion times for specific coding challenges, please contact your Customer Success Director.
Evaluating the Solution
There are a two useful tools available when evaluating the candidate’s responses:
- Statics analysis: A tool that provides information to highlight possible coding errors or best practices that could have been used.
- Code Similarity score: measures the uniqueness of the candidate’s code when compared with other solutions to the same challenge using the same language.