June 2026 | Discontinuation of GitHub Integration in AI Collaboration Format

Account

Overview

We are discontinuing the GitHub Integration in the AI Collaboration format. Accordingly, we have overhauled the exam flow for candidates as well as the evaluation and deliverable specifications for companies.

Important: This specification change is intended for notification to companies (clients) only. No announcements will be created for candidates.

Changes & Impact for Companies (Clients)

1. Changes to Evaluation Criteria

  • Evaluation Subject: We will discontinue test case evaluations for "Coding Ability" and "Team Development Ability."
  • Impact on Past Evaluations: Only submissions evaluated after the release will be subject to the new criteria; therefore, past evaluation results will not be affected.

2. How to Review Deliverables

  • Reviewing Deliverables: You can continue to review code deliverables and deep-dive interview questions on GitHub in Pull Request format, as before.
  • Changes to Author Name: Due to the discontinuation of the integration, the creator of the Pull Request and the author of the commits will appear under the name of the HireRoo bot rather than the candidate's own account.

Changes for Candidates (Information for Companies to Note/Guide)

1. Simplified Exam Start Flow

  • Removal of Steps: The steps for GitHub integration and Pull Request selection have been removed.
  • Screen Transition: Candidates will transition directly to the codeserver (development environment) immediately after starting the exam.
  • Utilizing Wait Time: Even while the environment is booting up (waiting time), candidates can review the problem statement and brainstorm with the AI through the chat interface.

2. UI Changes

  • Relocation of Supplemental Information: The supplemental information previously located in the "Issue Review Step" has been moved to the Exam Guide tab within the screen.

3. Changes to Submission Method

  • Removal of Submission Action: There is no longer an explicit submission action (such as clicking a button).
  • Automatic Evaluation: The deliverables as of the end of the exam (time limit) will automatically be used as the subject for evaluation.