Senior Software Engineer - 35501 (San Francisco) Job at Turing, San Francisco, CA

M3A0bjd2UWRWaXRFM3JSdzZZUUVjM3JOT0E9PQ==
  • Turing
  • San Francisco, CA

Job Description

2 days ago Be among the first 25 applicants

We are developing high-quality training and evaluation datasets to improve how Large Language Models (LLMs) perform on real software engineering problems. The core of this project involves identifying and curating verifiable coding tasks from public GitHub repositories, supported by a human-in-the-loop review process.

As a contractor on this project, you will review code written by AI to solve real software tasks. Your feedback will help improve how future AI models learn to write and understand code.

Key Responsibilities

  • Review and compare 34 model-generated code responses for each task using a structured ranking framework
  • Assess code changes (diffs) for correctness, quality, readability, and performance
  • Provide clear, concise explanations for your ranking decisions
  • Maintain consistency and fairness across all evaluations
  • Identify and document edge cases or unusual model behavior
  • Collaborate with the team to improve evaluation processes and identify improvement areas

Required Qualifications

Professional Experience

  • Several years of experience as a software engineer (experience working as a data scientist will not be considered)
  • Minimum 2 years of experience as a full-stack engineer at a leading tech product company (e.g., Google, Shopify, Microsoft, Snowflake, Meta, PayPal, etc.)

Note: Experience from contractual or part-time roles will not be considered. Only full-time employment qualifies.

Technical Skills

  • Strong understanding of software design, debugging, and engineering best practices
  • Familiarity with code review processes and version control systems
  • Ability to analyze and compare real-world code changes
  • Excellent written communication skills for clearly explaining technical evaluations

Preferred Qualifications

  • Degree from a top-ranked university is preferred but not required
  • Experience working with LLM-generated code or AI evaluation projects
  • Background in developer tools or systems automation
  • Exposure to AI research or developer agents
  • Commitment: 1020 hours/week, with flexible work hours (partial overlap with Pacific Time)
  • Duration: 1 month (starting next week, with potential for extension)
  • Compensation: $50$150/hour, based on experience, geography, and skill level

About Turing:

Turing is one of the worlds fastest-growing AI companies, pushing the boundaries of AI-assisted software development. Our mission is to empower the next generation of AI systems to reason about and work with real-world software repositories. Youll be working at the intersection of software engineering, open-source ecosystems, and frontier AI.

If you have strong software engineering expertise and are interested in helping shape the next generation of AI-assisted development tools, we encourage you to apply.

Seniorit y level

  • Mid-Senior level

Employment type

  • Contract

Job function

  • Information Technology and Engineering
  • Software Development

About listings: Referrals are not a guarantee of interview opportunities. This description reflects the role to be performed and does not include all responsibilities and requirements.

#J-18808-Ljbffr

Job Tags

Full time, Part time, For contractors, Flexible hours,

Similar Jobs

TechOp Solutions International

Remote Call Center Representative Job at TechOp Solutions International

 ...nearby cities. Duties: ~ Answer and track incoming calls ~ Prepare and submit accurate, detailed reports in government...  ...as assigned Requirements ~3 +experience in a call center ~ Associates Degree ~ Proven ability to... 

Wix Pie LLC

Jets Pizza Delivery Driver Job at Wix Pie LLC

 ...Job Description Job Description Jets Pizza in Wixom Michigan is hiring for delivery driver positions! We are looking to fill a few part time positions. Drivers must have their own vehicle and have a good standing driving record. Enjoy a fun fast paced environment... 

Pattern Promotions

Entry Level Marketing Assistant Job at Pattern Promotions

Entry Level Marketing AssistantCompany: Pattern PromotionsLocation: Austin, TX Salary: $60,000 - $68,000 per yearJob Type: Full-timeAbout UsPattern Promotions is a dynamic marketing firm specializing in brand enhancement and promotional campaigns tailored to... 

Insight Global

Cloud Security Engineer Job at Insight Global

 ...more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: Hashicorp Vault highly preferred 10 years of previous program leadership and/or relevant consulting experience Knowledge of and demonstrated... 

National Health Partners

Internal Medicine Opportunity - welcome J1 or H1b visa holders. FQHC location Job at National Health Partners

 ...Job Description Job Description Outpatient Internal Medicine Opportuntiy (Sponsor of H1b & J1 visa holders) FQHC location Live within 2 hours of Balitmore, 2.5 hours of Philadelphia, PA & Piittsburgh, PA! Join 2 other Internal Medicine doctors and 2 Mid-level...