June 2026 | Released "Interactive Problems" in AI-Collaboration Format

Account

Background of the Release

Conventional problems often presented requirements upfront, resulting in a clear output. In practical work, however, requirements are rarely perfectly organized; they are often ambiguous and sometimes contradictory. One must extract requirements from these situations and decide what to prioritize.

To evaluate information-gathering, problem-solving, and communication skills in a more practical setting, we have released "Interactive Problems" in an AI-collaboration format.

What are Interactive Problems (AI-Collaboration Format)?

Interactive Problems are a new type of challenge where the necessary information is not explicitly stated in the problem description.

Candidates progress through the task by interviewing virtual stakeholders (business representatives) via a chat panel on the challenge screen to extract current conditions, constraints, and acceptance criteria. Just like in real-world scenarios, the information provided is incomplete and may contain contradictions.

There is no predetermined "correct tech stack" or "correct architecture." The evaluation focuses on the decision-making process itself: what information was extracted, what assumptions were made, and what was prioritized, deferred, or rejected.

Skills Evaluated

In addition to the implementation skills measured by conventional coding challenges, Interactive Problems allow for the evaluation of the following:

  • Coding Proficiency: Readability, reusability, etc.
  • Team Development Skills: Quality and appropriateness of commit messages, Pull Request descriptions, etc.
  • Requirement Adaptation: The ability to discover and select requirements from contradictory materials.
  • Problem-Solving Ability: Consideration of counterexamples/exceptions, logical consistency, prioritization, etc.
  • Communication Skills: Understanding intent, verification, summarization, clear descriptions, etc.
  • AI Collaboration Skills: Environment setup, output quality assurance, control of execution, specification of intent, etc.
  • Companies looking to identify talent who can operate in environments where requirements are not fully solidified.
  • Teams that want to incorporate upstream judgment and design capabilities into their hiring criteria, beyond just implementation skills.
  • Companies that want to hire engineers with fundamental engineering capabilities while assuming the use of AI.

For more detailed information regarding this feature and actual screen images, please refer to the following pages:

About the AI-Collaboration Format: For an overview of the AI-collaboration format and its basic mechanisms, please see the AI-Collaboration Format Overview Page.

About Recruiter Reports: For details on how to view and utilize the reports available to recruiters, please see the Report Description Page.

About the Candidate Experience: To understand the test screen and workflow experienced by candidates, please see the Candidate Experience Page.

Available Plans

Companies currently using the Standard Plan or higher can utilize these problems until the end of September 2026. For usage after October 2026, please contact your dedicated Customer Success representative.