Data Scientist

Vor 3 Tagen

Frankfurt, Deutschland Mercor Vollzeit

Job Description: AI Task Evaluation & Statistical Analysis Specialist Role Overview We're seeking a data-driven analyst to conduct comprehensive failure analysis on AI agent performance across finance-sector tasks. You'll identify patterns, root causes, and systemic issues in our evaluation framework by analyzing task performance across multiple dimensions (task types, file types, criteria, etc.). Key Responsibilities Statistical Failure Analysis: Identify patterns in AI agent failures across task components (prompts, rubrics, templates, file types, tags) Root Cause Analysis: Determine whether failures stem from task design, rubric clarity, file complexity, or agent limitations Dimension Analysis: Analyze performance variations across finance sub-domains, file types, and task categories Reporting & Visualization: Create dashboards and reports highlighting failure clusters, edge cases, and improvement opportunities Quality Framework: Recommend improvements to task design, rubric structure, and evaluation criteria based on statistical findings Stakeholder Communication: Present insights to data labeling experts and technical teams Required Qualifications Statistical Expertise: Strong foundation in statistical analysis, hypothesis testing, and pattern recognition Programming: Proficiency in Python (pandas, scipy, matplotlib/seaborn) or R for data analysis Data Analysis: Experience with exploratory data analysis and creating actionable insights from complex datasets AI/ML Familiarity: Understanding of LLM evaluation methods and quality metrics Tools: Comfortable working with Excel, data visualization tools (Tableau/Looker), and SQL Preferred Qualifications Experience with AI/ML model evaluation or quality assurance Background in finance or willingness to learn finance domain concepts Experience with multi-dimensional failure analysis Familiarity with benchmark datasets and evaluation frameworks 2-4 years of relevant experience

  • Senior Data Scientist

    Vor 5 Tagen

    Frankfurt am Main, Deutschland Tiro Partners Vollzeit

    Full Time Frankfurt am Main, Hesse, Germany (Hybrid) **Salary**: €80,000 **Data Scientist - Manufacturing | Full Time, Permanent | Frankfurt | B1 German** Tiro have partnered an award-winning business that develops and delivers solutions in the field of AI for the Manufacturing, automotive and process industries. As a Data Scientist you will design...

  • Data Scientist

    vor 1 Woche

    Frankfurt am Main, Hessen, Deutschland IQVIA Vollzeit 80.000 € - 120.000 € pro Jahr

    Data ScientistEMEA Data Science & Advanced AnalyticsFrankfurt am Main, Deutschland (Hybrid)Wir suchen eine hochmotivierte und neugierige Persönlichkeit als Data Scientist zur Verstärkung unseres Teams. In dieser Rolle entwickeln Sie neue Produkte, verbessern bestehende Lösungen und unterstützen innovative Projekte. Sie arbeiten mit...

  • Chemoinformatics Data Scientist

    vor 2 Wochen

    Frankfurt am Main, Deutschland Bayer Vollzeit

    **At Bayer we’re visionaries, driven to solve the world’s toughest challenges and striving for a world where ,Health for all, Hunger for none’ is no longer a dream, but a real possibility. We’re doing it with energy, curiosity and sheer dedication, always learning from unique perspectives of those around us, expanding our thinking, growing our...

  • Data Scientist

    vor 1 Woche

    Frankfurt am Main, Hessen, Deutschland ITCS Conference Vollzeit 80.000 € - 120.000 € pro Jahr

    EventsITCS Darmstadt ITCS Hamburg ITCS KölnRECAPITCS MünchenRECAPITCS FrankfurtNov. 2025Event RecapsChat DateJobbörseAktuelle JobangeboteUnternehmenAktuelle AusstellerMediathekTech PodcastAlle Vorträge On-DemandFür UnternehmenAussteller werdenTech4HRStellenanzeigen schaltenKooperationenBehind the Scenes TourÜber unsNachhaltigkeitAnmeldenGermanGerman...

  • Data Scientist

    Vor 3 Tagen

    Frankfurt am Main, Hessen, Deutschland Deutsche Börse Group Vollzeit 500.000 € - 1.000.000 € pro Jahr

    Your area of workEurex Clearing faces various types of risk and has comprehensive risk management policies and services in place to promote integrity, transparency, efficiency, and the safety of financial markets. The CCP risk management department is responsible to define these policies and effectively operate related procedures.The Risk Design team within...

  • Data Scientist/Machine Learning Expert

    Vor 5 Tagen

    Frankfurt, Deutschland MA (Montreal Associates) Vollzeit

    Data Scientist/Machine Learning ExpertRemote/Hybrid - GermanyFull timeWe are working with a global leader in insurance and asset management who focus on accelerating digital transformation, leveraging AI and advanced analytics to reshape customer interactions, operational efficiency, and risk management.Now they are looking for a Data Scientist/Machine...

  • Data Scientist

    Vor 3 Tagen

    Frankfurt am Main, Hessen, Deutschland Deutsche Börse Group Vollzeit 90.000 € - 120.000 € pro Jahr

    Your career at Deutsche Börse GroupYour area of workEurex Clearing faces various types of risk and has comprehensive risk management policies and services in place to promote integrity, transparency, efficiency, and the safety of financial markets. The CCP risk management department is responsible to define these policies and effectively operate related...

  • Junior Data Scientist

    vor 1 Woche

    Frankfurt am Main, Hessen, Deutschland Arsenault Vollzeit 50.000 € - 80.000 € pro Jahr

    The Jr Data Scientist will help develop solutions for digital marketing use cases using statistical, data mining methods and data engineering solutions, working closely with our Analytics, Media Buying Account Management, Solutions Engineering, and Econometrics teams. The Jr Data Scientist should be on the right track to become a data specialist with a...

  • (Senior) Data Scientist

    Vor 5 Tagen

    Frankfurt Am Main, Deutschland ACTINEO Vollzeit

    **WE ARE LOOKING FOR **(Senior) Data Scientist - NLP (M/F/d) IN COLOGNE Shape the future of ACTINEO with helping us to implement our Cloud Strategy and build future SaaS Products. **Your Profile**: - Successfully **completed studies** in a quantitative discipline such as Mathematics, Applied Statistics, Computer Science or Computational Linguistics - **2+...

  • Senior Data Scientist

    vor 2 Wochen

    Frankfurt am Main, Deutschland Emma – The Sleep Company Vollzeit

    **Ready to lead, disrupt and reinvent the sleep industry?** We are **Emma - The Sleep Company**. Created in 2013, we are now the world's largest D2C sleep brand, available in over 30 countries and recommended by many consumer associations in EMEA, APAC, and the Americas. We're pushing the boundaries of technology to transform the world of sleep and we want...