Senior/Staff Code Review Experts
Vor 3 Tagen
Mercor is partnering with a top AI research organization to evaluate and improve how coding assistants reason, act, and communicate during development workflows. We're seeking technically sharp experts (especially those with experience in code review, testing, or documentation) to assess full transcripts of user–AI coding conversations. This short-term, fully remote engagement helps shape the future of developer-assisting AI systems.
Key Responsibilities
• Review long-form transcripts between users and AI coding assistants
• Analyze the AI's logic, execution, and stated actions in detail
• Score each transcript using a 10-point rubric across multiple criteria
• Optionally write brief justifications citing examples from the dialogue
• Detect mismatches between claims and actions (e.g., saying "I'll run tests" but not doing so)
Ideal Qualifications
Top choices:
• Senior or Staff Engineers with deep code review experience and execution insight
• QA Engineers with strong verification and consistency-checking habits
• Technical Writers or Documentation Specialists skilled at comparing instructions vs. implementation
Also a strong fit:
• Backend or Full-Stack Developers comfortable with function calls, APIs, and test workflows
• DevOps or SRE professionals familiar with tool orchestration and system behavior analysis
Languages and Tools:
• Proficiency in Python is helpful (most transcripts are Python-based)
• Familiarity with other languages like JavaScript, TypeScript, Java, C++, Go, Ruby, Rust, or Bash is a plus
• Comfort with Git workflows, testing frameworks, and debugging tools is valuable
More About the Opportunity
• Remote and asynchronous — complete tasks on your own schedule
• Must complete each transcript batch within 5 hours of starting (unlimited tasks to be done)
• Flexible, task-based engagement with potential for recurring batches
Compensation & Contract Terms
• Competitive hourly rates based on geography and experience
• Contractors will be classified as independent service providers
• Payments issued weekly via Stripe Connect
Application Process
• Submit your resume to begin
• If selected, you'll receive rubric documentation and access to the evaluation platform
• Most applicants hear back within a few business days
About Mercor
• Mercor is a talent marketplace that connects top experts with leading AI labs and research organizations
• Our investors include Benchmark, General Catalyst, Adam D'Angelo, Larry Summers, and Jack Dorsey
• Thousands of professionals across law, engineering, and research contribute to frontier AI projects via Mercor
-
Expert Reviewer
vor 2 Wochen
Berlin, Berlin, Deutschland Mercor Vollzeit 50.000 € - 70.000 € pro Jahr1. Role Overview Mercor is seeking highly skilled expert reviewers to support a leading AI research initiative focused on evaluating and improving large-scale text outputs. This short-term, remote opportunity involves critically reviewing written material to identify logical inconsistencies, inaccuracies, or unclear reasoning. Ideal candidates will have...
-
Staff/Senior Software Engineer
vor 2 Wochen
Berlin, Berlin, Deutschland Ledgy Vollzeit 80.000 € - 160.000 € pro JahrAt Ledgy, we're on a mission to make Europe a powerhouse of entrepreneurship by building a modern, tech-driven equity management and financial reporting platform for private and public companies. In 2025, we aim to be the leading provider for European IPOs and reporting for share-based payments. We are a value-based company with a core focus on being humble,...
-
Staff/Senior Software Engineer
Vor 5 Tagen
Berlin, Berlin, Deutschland Ledgy Vollzeit 120.000 € - 180.000 € pro JahrAt Ledgy, we're on a mission to make Europe a powerhouse of entrepreneurship by building a modern, tech-driven equity management and financial reporting platform for private and public companies. In 2025, we aim to be the leading provider for European IPOs and reporting for share-based payments. We are a value-based company with a core focus on being humble,...
-
Senior Staff Engineer, Food Systems
vor 1 Woche
Berlin, Berlin, Deutschland HelloFresh Vollzeit 100.000 € - 150.000 € pro JahrThe roleWe are looking for a Senior Staff Engineer who combines deep expertise in system architecture with strong hands-on development skills and experience in AI technologies. In this role, you will shape the architectural vision, guide cross-functional teams, and actively contribute to codebases while mentoring the next generation of engineers. You'll...
-
Senior Staff Database C
vor 2 Wochen
Berlin, Berlin, Deutschland ServiceNow Vollzeit 120.000 € - 180.000 € pro JahrCompany Description It all started in sunny San Diego, California in 2004 when a visionary engineer, Fred Luddy, saw the potential to transform how we work. Fast forward to today — ServiceNow stands as a global market leader, bringing innovative AI-enhanced technology to over 8,100 customers, including 85% of the Fortune 500. Our intelligent cloud-based...
-
Senior Security Engineer
Vor 5 Tagen
Berlin, Berlin, Deutschland HelloFresh Vollzeit 80.000 € - 120.000 € pro JahrThe roleWe're looking for a new teammate to join us on the journey of keeping HelloFresh a trusted name - someone with a passion for security and appetite for new challenges. Security Engineers work in a variety of ways to constantly iterate and improve HelloFresh's security posture. You will be part of the squad responsible for maintaining and improving...
-
Senior Product Designer
vor 1 Woche
Berlin, Berlin, Deutschland DKB Code Factory Vollzeit 90.000 € - 120.000 € pro JahrWelcome at DKB Code Factory…. { { … a_place_to_stay_yourself:} } ; { { … a_place_to_stay_curious:As a (Senior) Product Designer - Design Systems, your mission is to mature and scale DKB's design system into a flexible, multi-brand foundation that empowers our product teams to design consistently and efficiently. You will play a key role in evolving...
-
Senior Expert DevSecOps DXL
Vor 5 Tagen
Berlin, Berlin, Deutschland Vodafone Vollzeit 80.000 € - 120.000 € pro JahrSenior Expert DevSecOps DXL (m/w/d)Stellen-ID: 267322Bei Vodafone arbeiten wir jeden Tag an einer besseren Zukunft. Für eine Welt, die besser vernetzt, inklusiver und nachhaltiger ist. Denn für uns ist Technologie nur so stark wie die Menschen, die sie nutzen. Sei dabei und lass uns gemeinsam die Welt von morgen gestalten.Als Senior Expert DevSecOps...
-
Staff Application Security Engineer
vor 2 Wochen
Berlin, Berlin, Deutschland Affinidi - Internal Job Board Vollzeit 80.000 € - 120.000 € pro JahrAbout the role:We are in search for an Application Security Engineer, Staff (m/f/d) to join our Security Team. In this role, you'll help shape and guide the security strategy aligned to international standard and regulatory practices across Affinidi's various workstreams and products. This includes conducting security assessments, leading application...
-
Staff Software Engineer
Vor 7 Tagen
Berlin, Berlin, Deutschland Ingestro Vollzeit 80.000 € - 120.000 € pro JahrWhat will you doLead in the code for our core product (Data Pipeline), while staying fluent across our other codebases (Importer, User Platform, Admin Panel). Write reference implementations and unblock complex work.Shape the architecture of our scalable data pipeline product in close collaboration with senior engineers and the Tech Lead.Define and enforce...