Home
Jobs
Crossing Hurdles
Software Engineer – LLM Code Evaluator | Remote

Software Engineer – LLM Code Evaluator | Remote

Remote

United states

$ 130 /hour

Freelance

16-03-2026

Share this job:

Score my CV

Skills

Problem Solving Python JavaScript TypeScript Test git

Job Specifications

Position: Software Engineer (Trajectory)

Type: Hourly contract

Compensation: $70 to $130 per hour

Location: Remote

Commitment: 10 to 40 hours per week

Role Responsibilities

Review model generated code trajectories on real world software engineering tasks.
Reconstruct and annotate chain of thought reasoning behind each solution step.
Document debugging logic, decision points, and problem solving strategies.
Use full task context including codebases, issues, and test cases to infer reasoning.
Ensure annotations reflect realistic developer workflows and technical accuracy.

Requirements

Strong professional software engineering experience.
Bachelor’s degree in Software Engineering, Computer Science, or a related field.
Strong proficiency in Python, JavaScript, TypeScript, or similar languages.
Familiarity with Git based workflows including pull requests and issue tracking.
Ability to clearly articulate technical reasoning in structured written form.

Application Process

Upload resume
Short Interview
Submit form

About the Company

At Crossing Hurdles, we specialise in customised recruitment and staffing solutions designed to drive success for businesses and professionals. Our focus is on connecting organisations with top-tier talent by sourcing, screening, and presenting only the top 1% of candidates across a wide range of industries. We work closely with clients to understand their unique needs, ensuring that we find candidates who not only fit the role but also align with their organizational culture. Over the past few quarters, we've successfully p... Know more