Senior Data Engineer

vor 4 Wochen

Berlin, Berlin, Deutschland dltHub Vollzeit
About the Role

We are seeking a highly skilled Senior Software Engineer to join our team at dltHub. As a key member of our core product team, you will collaborate closely with our CTO to design and implement features that make dlt a gateway to the emerging Pythonic Composable Data Stack.

The ideal candidate will have experience in building data apps or products based on the Composable Data Stack and be familiar with Python libraries such as duckdb, arrow, datafusion, and delta-rs. They will also have a strong understanding of the Modern Data Stack and be able to combine both worlds effectively.

Responsibilities will include designing and implementing OSS features, listening to user needs, working with customers on commercial projects, and maintaining the open-source project.

We value autonomy and efficiency in our work culture and offer a range of benefits, including set hours for communication and deep work, a budget for learning and development, and an ESOP plan for employees.

  • Key Responsibilities:
  • Design and implement OSS features that integrate query engines, transformation frameworks, and table formats with our library.
  • Listen to user needs and work with customers on commercial projects.
  • Maintain the open-source project, including reviewing PRs, resolving issues, and communicating with community contributors.
Requirements
  • Experience in building data apps or products based on the Composable Data Stack.
  • Familiarity with Python libraries such as duckdb, arrow, datafusion, and delta-rs.
  • Strong understanding of the Modern Data Stack and ability to combine both worlds effectively.
  • Fluency in writing Python code, including Python typing, unit testing, and writing docstrings.
  • Familiarity with GitHub workflows, including pull requests, code reviews, and CI/CD services.
Nice to Have
  • Experience with DevOps, including CI systems like GitHub Actions, Docker, and Kubernetes.
  • Experience with machine learning, including toolsets, workflows, and practical applications.

  • Senior Data Engineer

    vor 2 Wochen

    Berlin, Berlin, Deutschland Media Impact GmbH & Co. KG Vollzeit

    Als Senior Data Engineer bei Media Impact GmbH & Co. KGWir suchen nach erfahrenen Technikern, die unsere Dateninfrastruktur entwickeln und verbessern. Als Senior Data Engineer bist du verantwortlich für die Entwicklung und Implementierung von Datenbank- und Datenanalyse-Lösungen.Deine Aufgaben:Entwickle und implementiere Datenbank- und...

  • Senior Data Engineer

    vor 1 Monat

    Berlin, Berlin, Deutschland Gemma Analytics Vollzeit

    About Gemma AnalyticsWe are a Berlin-based company specializing in generating insights in high-performance data infrastructure. Our team of data enthusiasts has helped over 70 companies become more data-driven and successful.Job DescriptionWe are seeking a Senior Data Engineer to join our team. As a Senior Data Engineer, you will play a critical role in...

  • Senior Data Platform Engineer

    vor 4 Wochen

    Berlin, Berlin, Deutschland Deutsche Bank Vollzeit

    Job Title: Senior Data Platform EngineerAbout the Role:We are seeking a highly skilled Senior Data Platform Engineer to join our team at Deutsche Bank Technology in Berlin. As a key member of our Cash Data domain, you will be responsible for designing and implementing a hybrid data platform that includes GKE, Kafka, and distributed Clickhouse database...

  • Senior Data Infrastructure Engineer

    vor 4 Wochen

    Berlin, Berlin, Deutschland ING Deutschland Vollzeit

    Senior Data Infrastructure Engineer Wir suchen nach einem erfahrenen Senior Data Infrastructure Engineer , der unsere Dateninfrastruktur weiterentwickeln und verbessern möchte. Deine Aufgaben Datenpipelines : Als Senior Data Infrastructure Engineer bist Du für die Verwaltung, Erstellung, Konzeption und Implementierung von Cloud- und...

  • Senior Data Infrastructure Engineer

    vor 4 Wochen

    Berlin, Berlin, Deutschland ING Deutschland Vollzeit

    Senior Data Infrastructure EngineerWir suchen nach einem erfahrenen Senior Data Infrastructure Engineer, der sich auf die Planung, Implementierung und Wartung von Cloud- und Dateninfrastrukturen spezialisiert hat. Du bist verantwortlich für die Integration neuer Datenquellen in Snowflake, die Sicherstellung der Zuverlässigkeit und Effizienz unserer...

  • Senior Data Engineer

    vor 2 Wochen

    Berlin, Berlin, Deutschland 0010 Deutsche Bank Aktiengesellschaft Vollzeit

    About 0010 Deutsche Bank AktiengesellschaftAt Deutsche Bank, we strive to create a diverse and inclusive work environment that fosters innovation and growth. Our technology team in Berlin is at the forefront of financial services innovation, using cutting-edge technologies to build #GlobalHausbank solutions.We are committed to building a workforce that...

  • Senior Data Engineer

    vor 4 Wochen

    Berlin, Berlin, Deutschland mrge - commerce advertising Vollzeit

    Data Engineer Role at mrgeWe are seeking a skilled Data Engineer to join our team at mrge, a leading Commerce Advertising platform. As a Data Engineer, you will play a crucial role in designing, building, and maintaining our cloud-based data platform.Key Responsibilities:Design and develop data pipelines to ensure efficient data processing and...

  • Junior Data Engineer

    vor 4 Wochen

    Berlin, Berlin, Deutschland Data Reply Vollzeit

    Unsere HerausforderungWir suchen einen Junior Data Engineer, der sich mit uns gemeinsam an der Entwicklung von Datenplattformen und Cloud-Lösungen beteiligen möchte. Als Teil unseres Teams wirst du an der Architektur und Implementierung von hochmodernen Datenplattformen und Cloud-Lösungen arbeiten, um die beste Technologie für unsere Kunden...

  • Senior Data Engineer

    vor 4 Wochen

    Berlin, Berlin, Deutschland actcon GmbH Vollzeit

    Beschreibung:Wir suchen im Zuge der Direktvermittlung einen Senior Data Engineer für unsere Cloud-basierte Datenplattform. Als wichtiger Teil unseres internationalen Teams sind Sie verantwortlich für die Administration, Wartung und Optimierung unserer PostgreSQL-Datenbank und die Umsetzung von Datenbereitstellungspipelines für Unternehmensanwendungen und...

  • Senior Data Engineer

    vor 4 Wochen

    Berlin, Berlin, Deutschland Technology & Strategy Vollzeit

    At Technology & Strategy, we are looking for a skilled Data Engineer to join our team.Key Responsibilities:Work with our science and engineering teams to build scalable systems for AI reasoning with Large Language Models (LLMs).Develop a system that generates automatically annotated data using an existing reasoning engine.Handle large-scale data annotations...

  • Senior Cloud Data Engineer

    vor 4 Wochen

    Berlin, Berlin, Deutschland 0010 Deutsche Bank Aktiengesellschaft Vollzeit

    About the RoleWe are seeking a highly skilled Senior Cloud Data Engineer to join our dynamic team at Deutsche Bank Technology in Berlin. As a key member of our Anti-Financial Crime Technology Risk Assessment Team, you will work with global, cross-functional teams to build solutions that allow for the execution of a controlled and sustainable process based on...

  • Senior Data Engineer

    vor 1 Monat

    Berlin, Berlin, Deutschland Sonova Vollzeit

    As a Senior Data Engineer at Sonova, you will play a crucial role in designing and developing a central marketing data platform, ensuring the reliability and scalability of our data infrastructure.Your Responsibilities:Design and implement data pipelines on Azure, leveraging your expertise in data engineering and cloud services.Develop and maintain a central...

  • Senior Data Architect

    vor 4 Wochen

    Berlin, Berlin, Deutschland Trade Republic Vollzeit

    At Trade Republic, our mission is to empower Europeans to take control of their wealth. We are a leading savings platform, serving over one million customers, with users holding over €6 billion on our platform.We are seeking a Senior Data Engineer to join our Data Platform team, where you will play a key role in creating the underlying foundation that...

  • Senior Data Platform Engineer

    vor 4 Wochen

    Berlin, Berlin, Deutschland 0010 Deutsche Bank Aktiengesellschaft Vollzeit

    Job Title: Senior Data Platform EngineerJob Summary:We are seeking a highly skilled Senior Data Platform Engineer to join our team at Deutsche Bank Technology in Berlin. As a key member of our Data Tribe, you will be responsible for designing, implementing, and maintaining scalable and reliable data infrastructure solutions on Google Cloud Platform.Key...

  • Senior Data Engineer

    vor 1 Monat

    Berlin, Berlin, Deutschland Central Parking Vollzeit

    Data Engineering RoleWe are seeking a highly skilled Data Engineer to join our team at Central Parking. As a Data Engineer, you will be responsible for designing, constructing, installing, testing, and maintaining highly scalable data management systems.Key ResponsibilitiesDesign and implement data management systems that meet business requirements and...

  • Senior Data Engineer

    vor 4 Wochen

    Berlin, Berlin, Deutschland Project A Ventures Vollzeit

    About the RoleWe're seeking an experienced Senior Data Engineer to support our data strategies and work alongside a team of ambitious Engineers.In this role, you'll craft, clean, and optimise large datasets to make them useful for various business use cases.You'll collaborate with stakeholders to understand business needs and translate them into actionable...

  • Senior Data Engineer

    vor 4 Wochen

    Berlin, Berlin, Deutschland 0010 Deutsche Bank Aktiengesellschaft Vollzeit

    About the RoleWe are seeking a highly skilled Senior Data Engineer to join our team at Deutsche Bank Technology in Berlin. As a key member of our Cash Data domain, you will be responsible for designing and building big data processing pipelines to support the development of data products.Your Key ResponsibilitiesCreate efficient big data processing pipelines...

  • Senior Data Engineer

    vor 3 Wochen

    Berlin, Berlin, Deutschland Ucaneo Vollzeit

    Your MissionAt Ucaneo, we're seeking a skilled Senior Data Engineer to join our Berlin-based team. As a key member of our startup, you'll focus on enabling an exponential data-driven learning curve through a digital twin and empiric validation.We're looking for a talented individual who can design a scalable data platform for real-time tracking, ensure...

  • Senior Data Engineer

    vor 1 Monat

    Berlin, Berlin, Deutschland Ucaneo Vollzeit

    Your MissionWe're seeking a skilled Senior Data Engineer to join our Berlin-based startup, focusing on enabling an exponential data-driven learning curve through a digital twin and empiric validation.Key Responsibilities:Designing a scalable data platform for real-time tracking to ensure a data-driven learning curve of a hardware industrial product based on...

  • Senior Data Engineer

    vor 1 Monat

    Berlin, Berlin, Deutschland Hive Technologies GmbH Vollzeit

    About the RoleWe are seeking a highly skilled Data Engineer to join our team at Hive Technologies GmbH. As a Data Engineer, you will be responsible for designing, developing, and maintaining scalable data infrastructure solutions to support our business operations.Key Responsibilities:Design and implement ETL/ELT processes using dbt, Python, and Redshift to...