AI Evaluation Engineer
vor 1 Tag
We're partnering with a fast -growing European AI tooling company that empowers developers, enterprises, and researchers to build, evaluate, and monitor AI models at scale. Their tools are shaping the next generation of safe, reliable, and human -aligned AI systems across industries.Joining this team means working at the cutting edge of AI infrastructure and having a direct impact on the tools that define how AI is tested, measured, and deployed worldwide.As an AI Evaluation Engineer, you will design and implement robust evaluation pipelines for AI models, helping clients and internal teams ensure their AI systems are accurate, ethical, and aligned with user needs. You'll collaborate closely with ML researchers, engineers, and product teams to create evaluation standards, metrics, and automated testing frameworks.This is an opportunity to shape how AI quality is measured globally while working in a collaborative, innovation -focused environment. Requirements Design, implement, and maintain evaluation pipelines for AI models, including LLMs, multimodal AI, and generative systems.Create and manage benchmark datasets and human -in -the -loop evaluation workflows.Assess model outputs for accuracy, safety, bias, and alignment with user instructions.Collaborate with product and engineering teams to integrate evaluation insights into tool development.Contribute to best practices for AI testing, model observability, and alignment metrics.Stay up -to -date with industry trends and emerging evaluation methodologies. Key skills & experience required: Technical background in Computer Science, Machine Learning, Data Science, or related fields.Experience with Python, LLM APIs, AI evaluation frameworks, or annotation platforms.Strong analytical skills with attention to detail and ability to reason through complex outputs.Interest in AI ethics, safety, and alignment.Excellent communication skills — able to translate evaluation results into actionable insights.Comfortable working in a fast -paced, innovation -driven environment. Benefits Work with cutting -edge AI evaluation technology that shapes the AI ecosystem.Collaborate with a diverse, passionate team of AI engineers and researchers.Competitive salary with equity options and flexible working arrangements.Opportunity to define AI evaluation standards used across products and clients globally.
-
Applied AI Engineer
vor 2 Wochen
Berlin, Berlin, Deutschland Boam AI VollzeitShip production ML and agentic AI powering market leaders worldwideBoam AI builds managed data solutions that transform messy, unstructured signals from public, private, and proprietary sources into structured, reliable, and always up-to-date intelligence on millions of SMBs and enterprises worldwide. These agentic systems power CRMs, data warehouses, AI...
-
Staff AI Engineer
Vor 3 Tagen
Berlin - Remote in Germany Bluefish AI VollzeitAbout the PositionAs a Staff AI Engineer, you'll serve as a technical leader for our LLM-powered products at the forefront of marketing and advertising technologies. You'll own critical architectural decisions, set quality bars, and lead multi‑team initiatives that drive measurable outcomes.As our Staff AI Engineer, you will lead the vision and execution...
-
Senior AI Engineer
vor 1 Woche
Berlin, Remote in Germany Bluefish AI VollzeitAbout the Position As a Senior AI Engineer, you'll spearhead the development of LLM-powered products at the forefront of marketing and advertising technologies. Utilizing your expertise in machine learning, large language models, and natural language processing, you'll play a pivotal role in designing, implementing, and enhancing our range of AI-driven...
-
Audio Data Engineer
vor 2 Wochen
Berlin, Deutschland ai-coustics VollzeitAbout us ai-coustics is building the reliability layer for Voice AI, the system that closes the gap between raw audio input and reliable machine understanding in production. By combining state-of-the-art speech and audio research with real-time, production-grade SDKs, we test, observe, and enable Voice AI systems to work in any environment. Our software is...
-
Founding AI Engineer
vor 1 Tag
Berlin, Berlin, Deutschland AI Futures VollzeitFounding AI Engineer | $3.5M Pre-Seed --> $15M Series A | Germany (Hybrid + Travel) | German SpeakingAI Futures have been exclusively retained to appoint a Founding AI Engineer for one of the most exciting AI Start-Ups in Europe who have already secured $3.5M in pre-seed funding and are on track to secure $15M Series A funding mid next yearThis is one of the...
-
Audio Data Engineer
vor 2 Wochen
Berlin, Berlin, Deutschland ai-coustics VollzeitAbout usai-coustics is building the reliability layer for Voice AI, the system that closes the gap between raw audio input and reliable machine understanding in production. By combining state-of-the-art speech and audio research with real-time, production-grade SDKs, we test, observe, and enable Voice AI systems to work in any environment.Our software is...
-
Audio ML Data Engineer
vor 18 Stunden
Berlin, Deutschland ai-coustics VollzeitAbout us ai-coustics is building the reliability layer for Voice AI, the system that closes the gap between raw audio input and reliable machine understanding in production. By combining state-of-the-art speech and audio research with real-time, production-grade SDKs, we test, observe, and enable Voice AI systems to work in any environment. Our software is...
-
Forward Deployed Engineer
vor 18 Stunden
Berlin, Deutschland ai-coustics VollzeitAbout us ai-coustics is building the reliability layer for Voice AI, the system that closes the gap between raw audio input and reliable machine understanding in production. By combining state-of-the-art speech and audio research with real-time, production-grade SDKs, we test, observe, and enable Voice AI systems to work in any environment. Our software is...
-
Forward Deployed Engineer
vor 2 Wochen
Berlin, Deutschland ai-coustics VollzeitAbout us ai-coustics is building the reliability layer for Voice AI, the system that closes the gap between raw audio input and reliable machine understanding in production. By combining state-of-the-art speech and audio research with real-time, production-grade SDKs, we test, observe, and enable Voice AI systems to work in any environment. Our software is...
-
Audio ML Data Engineer
vor 2 Wochen
Berlin, Deutschland ai-coustics VollzeitAbout us ai-coustics is building the reliability layer for Voice AI, the system that closes the gap between raw audio input and reliable machine understanding in production. By combining state-of-the-art speech and audio research with real-time, production-grade SDKs, we test, observe, and enable Voice AI systems to work in any environment. Our software is...
