Senior/Staff Code Review Experts

Vor 3 Tagen


Berlin, Berlin, Deutschland Mercor Vollzeit 80.000 € - 120.000 € pro Jahr

Mercor is partnering with a top AI research organization to evaluate and improve how coding assistants reason, act, and communicate during development workflows. We're seeking technically sharp experts (especially those with experience in code review, testing, or documentation) to assess full transcripts of user–AI coding conversations. This short-term, fully remote engagement helps shape the future of developer-assisting AI systems.

Key Responsibilities


• Review long-form transcripts between users and AI coding assistants


• Analyze the AI's logic, execution, and stated actions in detail


• Score each transcript using a 10-point rubric across multiple criteria


• Optionally write brief justifications citing examples from the dialogue


• Detect mismatches between claims and actions (e.g., saying "I'll run tests" but not doing so)

Ideal Qualifications

Top choices:


• Senior or Staff Engineers with deep code review experience and execution insight


• QA Engineers with strong verification and consistency-checking habits


• Technical Writers or Documentation Specialists skilled at comparing instructions vs. implementation

Also a strong fit:


• Backend or Full-Stack Developers comfortable with function calls, APIs, and test workflows


• DevOps or SRE professionals familiar with tool orchestration and system behavior analysis

Languages and Tools:


• Proficiency in Python is helpful (most transcripts are Python-based)


• Familiarity with other languages like JavaScript, TypeScript, Java, C++, Go, Ruby, Rust, or Bash is a plus


• Comfort with Git workflows, testing frameworks, and debugging tools is valuable

More About the Opportunity


• Remote and asynchronous — complete tasks on your own schedule


• Must complete each transcript batch within 5 hours of starting (unlimited tasks to be done)


• Flexible, task-based engagement with potential for recurring batches

Compensation & Contract Terms


• Competitive hourly rates based on geography and experience


• Contractors will be classified as independent service providers


• Payments issued weekly via Stripe Connect

Application Process


• Submit your resume to begin


• If selected, you'll receive rubric documentation and access to the evaluation platform


• Most applicants hear back within a few business days

About Mercor


• Mercor is a talent marketplace that connects top experts with leading AI labs and research organizations


• Our investors include Benchmark, General Catalyst, Adam D'Angelo, Larry Summers, and Jack Dorsey


• Thousands of professionals across law, engineering, and research contribute to frontier AI projects via Mercor


  • Expert Reviewer

    vor 2 Wochen


    Berlin, Berlin, Deutschland Mercor Vollzeit 50.000 € - 70.000 € pro Jahr

    1. Role Overview Mercor is seeking highly skilled expert reviewers to support a leading AI research initiative focused on evaluating and improving large-scale text outputs. This short-term, remote opportunity involves critically reviewing written material to identify logical inconsistencies, inaccuracies, or unclear reasoning. Ideal candidates will have...


  • Berlin, Berlin, Deutschland Ledgy Vollzeit 80.000 € - 160.000 € pro Jahr

    At Ledgy, we're on a mission to make Europe a powerhouse of entrepreneurship by building a modern, tech-driven equity management and financial reporting platform for private and public companies. In 2025, we aim to be the leading provider for European IPOs and reporting for share-based payments. We are a value-based company with a core focus on being humble,...


  • Berlin, Berlin, Deutschland Ledgy Vollzeit 120.000 € - 180.000 € pro Jahr

    At Ledgy, we're on a mission to make Europe a powerhouse of entrepreneurship by building a modern, tech-driven equity management and financial reporting platform for private and public companies. In 2025, we aim to be the leading provider for European IPOs and reporting for share-based payments. We are a value-based company with a core focus on being humble,...


  • Berlin, Berlin, Deutschland HelloFresh Vollzeit 100.000 € - 150.000 € pro Jahr

    The roleWe are looking for a Senior Staff Engineer who combines deep expertise in system architecture with strong hands-on development skills and experience in AI technologies. In this role, you will shape the architectural vision, guide cross-functional teams, and actively contribute to codebases while mentoring the next generation of engineers. You'll...


  • Berlin, Berlin, Deutschland ServiceNow Vollzeit 120.000 € - 180.000 € pro Jahr

    Company Description It all started in sunny San Diego, California in 2004 when a visionary engineer, Fred Luddy, saw the potential to transform how we work. Fast forward to today — ServiceNow stands as a global market leader, bringing innovative AI-enhanced technology to over 8,100 customers, including 85% of the Fortune 500. Our intelligent cloud-based...


  • Berlin, Berlin, Deutschland HelloFresh Vollzeit 80.000 € - 120.000 € pro Jahr

    The roleWe're looking for a new teammate to join us on the journey of keeping HelloFresh a trusted name - someone with a passion for security and appetite for new challenges. Security Engineers work in a variety of ways to constantly iterate and improve HelloFresh's security posture. You will be part of the squad responsible for maintaining and improving...


  • Berlin, Berlin, Deutschland DKB Code Factory Vollzeit 90.000 € - 120.000 € pro Jahr

    Welcome at DKB Code Factory…. { { … a_place_to_stay_yourself:} } ; { { … a_place_to_stay_curious:As a (Senior) Product Designer - Design Systems, your mission is to mature and scale DKB's design system into a flexible, multi-brand foundation that empowers our product teams to design consistently and efficiently. You will play a key role in evolving...


  • Berlin, Berlin, Deutschland Vodafone Vollzeit 80.000 € - 120.000 € pro Jahr

    Senior Expert DevSecOps DXL (m/w/d)Stellen-ID: 267322Bei Vodafone arbeiten wir jeden Tag an einer besseren Zukunft. Für eine Welt, die besser vernetzt, inklusiver und nachhaltiger ist. Denn für uns ist Technologie nur so stark wie die Menschen, die sie nutzen. Sei dabei und lass uns gemeinsam die Welt von morgen gestalten.Als Senior Expert DevSecOps...


  • Berlin, Berlin, Deutschland Affinidi - Internal Job Board Vollzeit 80.000 € - 120.000 € pro Jahr

    About the role:We are in search for an Application Security Engineer, Staff (m/f/d) to join our Security Team. In this role, you'll help shape and guide the security strategy aligned to international standard and regulatory practices across Affinidi's various workstreams and products. This includes conducting security assessments, leading application...


  • Berlin, Berlin, Deutschland Ingestro Vollzeit 80.000 € - 120.000 € pro Jahr

    What will you doLead in the code for our core product (Data Pipeline), while staying fluent across our other codebases (Importer, User Platform, Admin Panel). Write reference implementations and unblock complex work.Shape the architecture of our scalable data pipeline product in close collaboration with senior engineers and the Tech Lead.Define and enforce...