Create a Coding Test

Getting Started

Creating and Configuring a Coding Test

This article explains how to create a "Coding Test" for candidates to take, as well as the details of each setting item.

Definition of Terms

  • Coding Test: This is the "framework" that includes the combination of problems and time limits. You create this first to invite candidates.
  • Test: This refers to the individual exam data for each candidate. It is created when a candidate takes (accepts) the test from the Coding Test URL.

Creation Procedure

  1. Open "Coding Test List" from the side menu.
  2. Click the "Create Coding Test" button in the upper right corner of the screen.
  3. Enter the details for each setting item below and save.

1. Basic Settings

  • Title: Enter the administrative name for the test.
  • Description (Internal Use): Enter a summary of the test if necessary. This information is for internal management and will not be displayed on individual tests (candidate screens).

2. Problem Settings

How to Add Problems

You can set up to 10 problems. You can also reuse past test problems by selecting from "Select from History".

  • Fixed Problems: Add by clicking the "＋ Select Problem" button.
  • Problems Candidates Can Choose: Select "Add problems candidates can choose" from the ▼ button to the right of "＋ Select Problem".
  • Randomly Selected Problems: Select "Add randomly selected problems" from the ▼ button to the right of "＋ Select Problem".

Searching and Filtering Problems

The "Problem Search Screen" allows you to find problems using the following functions:

  • Search: Search by title, filter by problem type and difficulty.
  • Add/Remove: Add problems from the central list with "＋", and remove from the selected list on the right with "－".

Using Problem Sets

From "Problem Sets" on the left side of the screen, you can select sets according to your purpose.

  • Add: Add the problems included in the problem set to the current list.
  • Replace: Clear all currently selected problems and replace them with the contents of the problem set.

Custom Score

You can change the weighting of the score for each problem ( 1 to 100 ). The initial setting is even distribution, but please adjust if you want to place more emphasis on specific important problems.

3. Detailed Problem Settings

<h3>Time Limit</h3> The recommended time is automatically calculated based on the selected problems. You can set a maximum of 10,000 minutes (6 days, 22 hours, 40 minutes).

<h3>Language and Environment Settings</h3>

  • Specify Allowed Languages: Only displayed for coding problems.
  • Assist Function: (Standard plan or higher)
    • When turned on, candidates can use Web search / ChatGPT within the answer screen.
    • Usage history can be checked with the playback function.
  • Resource Type: Only displayed for system design problems.

4. Operation and Management Settings

<h3>Custom Forms</h3> You can add input fields other than name and email address (e.g., candidate ID) to the test start screen.

Important

  • Matching Item Names: If you want to use the same item as a previously created test, make sure the item names match exactly. Otherwise, it will be treated as a separate item.
  • CSV Export: Avoid setting the same name as standard items (e.g., "Name") as this will prevent CSV download.
  • No Changes After Acceptance: It is not possible to change the item names in the test report after a candidate has accepted.

<h3>Other Management Items</h3>

  • Maximum Number of Examinees: Sets the limit on the number of candidates. If not specified, it is unlimited.
  • Submission Deadline: Sets the "completion deadline" for the test. If this deadline is reached during the test, the test will end and be automatically submitted at that time.
  • Internal Memo: Details on how to input into ATS or handover items for interviewers. This will not be shared with candidates.
  • Tag Settings: Assign tags for selection management. These can be used for filtering on the list screen and for report analysis.

5. Permissions and Invitation Settings

<h3>Viewing Permissions</h3>

  • Viewable by members who know the link: All members with an account (excluding Talent role) can view the report.
  • Viewable only by specified members: Only specified members or groups can access and review. Notifications will also only be sent to the target individuals.

<h3>Message to Candidates</h3> Enter any precautions for taking the test. This will be displayed on the confirmation screen before starting and in the invitation email (if set).

<h3>Restriction on Eligible Users (Invitation Method)</h3>

  • Anyone who knows the link can take the test: A common URL will be issued. Any candidate who knows the URL can take the test.
  • Anyone who knows the password-protected link can take the test: HireRoo will send individual password-protected links via email.
    • With this setting, email invitation from HireRoo is required.
    • The invitation email language can be selected from Japanese or English.

<h3>Contact Information to Share with Candidates</h3> Set the inquiry email address to be included in the invitation email.

Operations After Creation

After completing the settings, click the "Save" button to create. After creation, you can perform the following operations from the "︙ (three dots)" menu on the list screen:

  • Edit: Change the settings.
  • Duplicate: Create another coding test with the same content.
  • Stop Acceptance: Invalidate the URL and stop new test submissions.