Senior/Staff Code Review Experts
Vor 3 Tagen
Mercor is partnering with a top AI research organization to evaluate and improve how coding assistants reason, act, and communicate during development workflows. We’re seeking technically sharp experts (especially those with experience in code review, testing, or documentation) to assess full transcripts of user–AI coding conversations. This short-term, fully remote engagement helps shape the future of developer-assisting AI systems. Key Responsibilities • Review long-form transcripts between users and AI coding assistants • Analyze the AI’s logic, execution, and stated actions in detail • Score each transcript using a 10-point rubric across multiple criteria • Optionally write brief justifications citing examples from the dialogue • Detect mismatches between claims and actions (e.g., saying “I’ll run tests” but not doing so) Ideal Qualifications Top choices: • Senior or Staff Engineers with deep code review experience and execution insight • QA Engineers with strong verification and consistency-checking habits • Technical Writers or Documentation Specialists skilled at comparing instructions vs. implementation Also a strong fit: • Backend or Full-Stack Developers comfortable with function calls, APIs, and test workflows • DevOps or SRE professionals familiar with tool orchestration and system behavior analysis Languages and Tools: • Proficiency in Python is helpful (most transcripts are Python-based) • Familiarity with other languages like JavaScript, TypeScript, Java, C++, Go, Ruby, Rust, or Bash is a plus • Comfort with Git workflows, testing frameworks, and debugging tools is valuable More About the Opportunity • Remote and asynchronous — complete tasks on your own schedule • Must complete each transcript batch within 5 hours of starting (unlimited tasks to be done) • Flexible, task-based engagement with potential for recurring batches Compensation & Contract Terms • Competitive hourly rates based on geography and experience • Contractors will be classified as independent service providers • Payments issued weekly via Stripe Connect Application Process • Submit your resume to begin • If selected, you’ll receive rubric documentation and access to the evaluation platform • Most applicants hear back within a few business days About Mercor • Mercor is a talent marketplace that connects top experts with leading AI labs and research organizations • Our investors include Benchmark, General Catalyst, Adam D’Angelo, Larry Summers, and Jack Dorsey • Thousands of professionals across law, engineering, and research contribute to frontier AI projects via Mercor
-
Senior/Staff Code Review Experts
vor 9 Stunden
Berlin, Deutschland Mercor VollzeitMercor is partnering with a top AI research organization to evaluate and improve how coding assistants reason, act, and communicate during development workflows. We’re seeking technically sharp experts (especially those with experience in code review, testing, or documentation) to assess full transcripts of user–AI coding conversations. This short-term,...
-
Senior/Staff Code Review Experts
Vor 3 Tagen
Berlin, Berlin, Deutschland Mercor Vollzeit 80.000 € - 120.000 € pro JahrMercor is partnering with a top AI research organization to evaluate and improve how coding assistants reason, act, and communicate during development workflows. We're seeking technically sharp experts (especially those with experience in code review, testing, or documentation) to assess full transcripts of user–AI coding conversations. This short-term,...
-
Expert Reviewer
vor 2 Wochen
Berlin, Deutschland Mercor Vollzeit1. Role Overview Mercor is seeking highly skilled expert reviewers to support a leading AI research initiative focused on evaluating and improving large-scale text outputs. This short-term, remote opportunity involves critically reviewing written material to identify logical inconsistencies, inaccuracies, or unclear reasoning. Ideal candidates will have...
-
Expert Reviewer
vor 2 Wochen
Berlin, Berlin, Deutschland Mercor Vollzeit 50.000 € - 70.000 € pro Jahr1. Role Overview Mercor is seeking highly skilled expert reviewers to support a leading AI research initiative focused on evaluating and improving large-scale text outputs. This short-term, remote opportunity involves critically reviewing written material to identify logical inconsistencies, inaccuracies, or unclear reasoning. Ideal candidates will have...
-
(Senior) Appian Architect
Vor 7 Tagen
Berlin, Deutschland BearingPoint Vollzeit(Senior) Appian Architect / Low-Code Plattform Experte (m/w/d) Berlin, Düsseldorf, Frankfurt am Main, Hamburg, Leipzig, München, Stuttgart, Walldorf Deine Benefits Deine zukünftigen Aufgaben Du verantwortest den ganzheitlichen Aufbau und die Administration von Appian-Plattformen - von der Systemarchitektur über Performance-Optimierung bis zur Skalierung...
-
Staff/Senior Software Engineer
vor 4 Wochen
Berlin, Deutschland Ledgy VollzeitAt Ledgy, we’re on a mission to make Europe a powerhouse of entrepreneurship by building a modern, tech-driven equity management and financial reporting platform for private and public companies. In 2025, we aim to be the leading provider for European IPOs and reporting for share-based payments. We are a value-based company with a core focus on being...
-
Senior Asset Quality Review Officer
Vor 5 Tagen
Berlin, Deutschland Deutsche Bank Vollzeit**Senior Asset Quality Review Officer (f/m/x)**: **Job ID**:R0359227**Full/Part-Time**:Full-time**Regular/Temporary**:Regular**Listed**:2024-11-29**Location**:Berlin**Position Overview**: **Details of the role and how it fits into the team**: Asset Quality Review (AQR) is an independent key control function with high importance in the regulatory environment....
-
Staff/Senior Software Engineer
vor 2 Wochen
Berlin, Berlin, Deutschland Ledgy Vollzeit 80.000 € - 160.000 € pro JahrAt Ledgy, we're on a mission to make Europe a powerhouse of entrepreneurship by building a modern, tech-driven equity management and financial reporting platform for private and public companies. In 2025, we aim to be the leading provider for European IPOs and reporting for share-based payments. We are a value-based company with a core focus on being humble,...
-
Staff/Senior Software Engineer
Vor 4 Tagen
Berlin, Berlin, Deutschland Ledgy Vollzeit 120.000 € - 180.000 € pro JahrAt Ledgy, we're on a mission to make Europe a powerhouse of entrepreneurship by building a modern, tech-driven equity management and financial reporting platform for private and public companies. In 2025, we aim to be the leading provider for European IPOs and reporting for share-based payments. We are a value-based company with a core focus on being humble,...
-
Expert Reviewer
vor 2 Wochen
Berlin, Deutschland Mercor Vollzeit1. Role Overview Mercor is seeking highly skilled expert reviewers to support a leading AI research initiative focused on evaluating and improving large-scale text outputs. This short-term, remote opportunity involves critically reviewing written material to identify logical inconsistencies, inaccuracies, or unclear reasoning. Ideal candidates will have...