Lead Data Engineer

Vor 5 Tagen

Deutschland Forsyth Barnes Vollzeit 110.000 € - 150.000 € Vertrag

About Us

Forsyth Barnes are delighted to be partnering with an online e-commerce company on a Lead Data Engineer position.

Job Description

The Lead Data Engineer is responsible for leading the design, development, and optimisation of scalable data platforms and pipelines to support the company's e-commerce operations and strategic objectives. The role provides technical leadership to the data engineering team, ensuring data quality, governance, integration, and platform reliability while collaborating with cross-functional stakeholders to deliver actionable business insights. It also drives data engineering best practices, innovation, and continuous improvement to enable data-driven decision-making, enhance customer experience, improve operational efficiency, and support business growth.

Key Responsibilities

Technical Ownership & Architecture

  • Own the technical design and implementation approach for data pipelines, warehouse models, and transformations

  • Define and evolve data modelling standards (e.g. star schema, incremental models, partitioning strategies)

  • Ensure solutions are scalable, performant, and cost-efficient across the data platform

  • Review and approve technical designs and code across the team

  • Act as the primary escalation point for complex technical challenges

Data Platform & Warehouse Ownership

  • Act as the day-to-day technical owner of the data warehouse (BAU)

  • Ensure consistency and maintainability across datasets, pipelines, and transformations

  • Drive improvements in performance, reliability, and observability

  • Lead technical input into the data warehouse rebuild and future evolution

Engineering Standards & Best Practice

  • Define and enforce engineering standards, patterns, and reusable components

  • Promote strong practices in:

  • version control

  • testing and validation

  • CI/CD for data pipelines

  • Ensure high-quality documentation of data models and pipelines

  • Identify and address technical debt proactively

Data Quality & Reliability

  • Lead implementation of data quality checks and monitoring frameworks

  • Ensure pipelines are robust, observable, and alerting appropriately

  • Drive improvements beyond basic checks (e.g. volumetric, anomaly detection, trend validation)

  • Support root cause analysis and resolution of data incidents

Technical Leadership & Mentorship

  • Provide hands-on technical guidance to engineers and senior engineers

  • Mentor team members on system design, coding standards, and problem-solving

  • Lead technical discussions, design review

Requirements

Data Architecture & Engineering

  • Detail: Designing scalable pipelines, modelling data flows, and building robust warehouse architectures.

  • At this level: Owns and defines how systems are built. Sets modelling standards, ensures consistency across pipelines, and makes pragmatic design decisions balancing speed, cost, and scalability.

Programming & Automation

  • Detail: SQL, dbt, Python, orchestration, CI/CD.

  • At this level: Expert practitioner. Produces high-quality, maintainable code and sets the standard for others. Introduces automation, testing, and deployment best practices across the team.

Data Quality & Observability

  • Detail: Monitoring, validation, reliability, incident handling.

  • At this level: Leads implementation of robust quality frameworks. Moves beyond basic checks to proactive monitoring and anomaly detection. Ensures trust in data outputs.

Technical Leadership

  • Detail: Mentoring, design authority, technical direction.

  • At this level: Acts as the go-to technical authority. Guides engineers in design decisions, challenges approaches, and elevates the overall technical capability of the team.

Problem Solving & Decision Making

  • Detail: Breaking down complex technical challenges.

  • At this level: Resolves ambiguous problems independently. Proposes clear, structured solutions and articulates trade-offs effectively