Viewing and Editing the Skill Index

Troubleshooting

Overview

The Skill Index is the structure of skills and evaluation items that HireRoo uses to evaluate assessment results. Starting from the standard skill index provided by HireRoo (Software Engineering Index), you can create your company version that reflects the perspectives your company values.

Once you publish your company version, subsequent internal assessments in Skill Development are evaluated with it. Support for Skill Interview and Skill Assessment is planned; until then, they are evaluated with the HireRoo standard. Evaluations against the HireRoo standard continue as well, so scores and ranks in the standard are not affected by the content of your company version.

Supported plans Viewing the Skill Index is available on all plans. Creating, editing, and publishing your company version is available on the Professional plan or higher.

Members with Admin Authorization or Manager Authorization can create, edit, and publish your company version.

Structure of the Skill Index

The Skill Index is a tree of skills and evaluation items.

Element Description
Skill Combines the scores of the skills or evaluation items under it. The weight among items that share the same parent determines how much each one affects the parent's score
Evaluation item A behavior to evaluate. Each has a detection method and five-level evaluation standards

The standard skill index consists of three skills, AI collaboration, problem solving, and communication, and the items under them.

Viewing the Skill Index

  1. Click Skill Index in the sidebar.
  2. If you have published your company version, it is shown. Otherwise, the standard is shown.

Select a skill or evaluation item in the tree or graph on the left to see its details on the right. For a skill, you can see the breakdown and ratios of the items under it. For an evaluation item, you can see its detection method and evaluation standards. The size and number of each circle in the graph show its weight ratio among items that share the same parent.

Click the version next to the title to switch to a past version or to Other skill indexes (the standard when you are viewing your company version, or your company version when you are viewing the standard).

Creating your company version

When you open the Skill Index without a company version, you can start creating one in the following ways.

Option Description
Create from the standard tree Copies the entire standard skill index
Create from this skill only Copies only the skill selected in the tree or graph and the items under it
Create from empty Starts with no skills or evaluation items

Creating one opens the draft editor. Until you publish your company version, evaluations use the standard.

You can rename your company version from next to the title. A new name takes effect immediately without publishing.

Editing the draft

To change your published company version, click Edit and edit the draft. If a draft is already in progress, you continue from it. Drafts are saved automatically and are not used for evaluation until you publish them.

Editing on the screen

Select an item in the tree or graph and edit it in the panel on the right.

  • Name: Enter the name in Japanese and English.
  • Breakdown: When you select a skill, you can change the weights of the items under it. The ratios and the graph update immediately.
  • Detection and Evaluation Standards: You can edit these when you select an evaluation item. Write the Japanese evaluation standards as five lines, one for each of score = 1, 0.75, 0.5, 0.25, and 0. A newly added evaluation item comes with these five lines prefilled.
  • Add Skill / Add Evaluation Item: Adds an item under the selected skill. Skills and evaluation items cannot be mixed under the same parent.
  • Delete: Deletes the selected item. If it has items under it, choose whether to keep them under its parent or delete them as well.

You can switch the center of the screen between Graph and YAML. To move items or make large changes, edit the YAML directly or ask the agent.

Asking the agent

Tell the Skill index agent on the right what you want to emphasize in evaluations, and it edits the draft. For example, ask "I want to evaluate the ability to explain design intent in words."

You can see the items the agent changed in the list and the highlights in the graph. You can undo the changes.

Reverting changes

  • Use the undo and redo icons to undo or redo recent changes.
  • Select Revert to the published version to reset the draft's content to the published version.
  • Select Clear draft to empty the draft's tree.
  • Click Discard draft to lose all changes in the draft. The published version does not change.

Publishing

  1. Click Review differences and publish.
  2. Review the differences from the published version (added, removed, content changed, weight changed, and moved).
  3. Click Publish.

Publishing creates a new version, and subsequent internal assessments are evaluated with it. Published versions cannot be changed, so you can later check which version was used for each evaluation.

You cannot publish while validation errors remain, such as an empty name or evaluation standards that are empty or not in the five-level format. Click the error count to see the affected items.

Notes

  • Publishing does not recalculate past evaluations. The new version is used for evaluations performed after publishing.
  • Changing the content of a standard evaluation item replaces it with your company's own evaluation item. Its position in the tree and its weight carry over, but it is no longer linked to past evaluations. If you only change the weight or move the item, it remains a standard evaluation item.
  • Your company version currently applies only to internal assessments in Skill Development. Candidate reports in Skill Interview and Skill Assessment continue to be evaluated with the HireRoo standard. Support for both is planned.