Composable Data Stack Engineer

vor 3 Wochen


Berlin, Berlin, Deutschland dltHub ScaleVector GmbH Vollzeit
Job Description

We are seeking a skilled Composable Data Stack Engineer to join our team at dltHub / ScaleVector GmbH. As a key member of our core product team, you will collaborate directly with our CTO to design and implement high-performance data processing libraries.

About the Role

As a Composable Data Stack Engineer, you will be responsible for integrating query engines, transformation frameworks, and table formats with our library. You will work closely with our customers in commercial projects where dlt is combined with existing "modern data stack" infrastructure. Additionally, you will maintain the open-source project with our team, reviewing PRs, resolving issues, and engaging with community contributors.

Requirements
  • You have experience in building data apps or products based on composable data stacks.
  • You are familiar with Pythonic data processing libraries, including duckdb, arrow, datafusion, lancedb, delta-rs, ibis, pyiceberg, sqlglot, kedro, and hamilton.
  • You have a degree in computer science, data science, or equivalent experience.
  • You are fluent in writing Python code, including Python typing, unit testing, and writing docstrings.
  • You are familiar with GitHub workflows, including pull requests, code reviews, CI/CD services, and more.
Nice to Have
  • You are based in Berlin and willing to work in our office regularly.
  • You have a hacker nature and enjoy optimizing code.
  • You have experience with DevOps, including CI systems, Docker, Kubernetes, AWS/GCP/Digital Ocean, and more.
  • You have experience with machine learning, including toolsets, workflows, and practical applications.
About Us

dltHub / ScaleVector GmbH is a leading provider of open-source data processing libraries. We are backed by Foundation Capital, Dig Ventures, and technical founders from companies such as Datadog, Instana, Hugging Face, MotherDuck, Mesosphere, Matillion, Miro, and Rasa. Our mission is to integrate dlt fully with the emerging Pythonic Composable Data Stack, creating a seamless experience for our users.



  • Berlin, Berlin, Deutschland dltHub Vollzeit

    About the RoleWe are seeking a skilled Data Engineer to join our team at dltHub. As a key member of our core product team, you will collaborate closely with our CTO to design and implement features that integrate our library with the emerging Pythonic Composable Data Stack.Key responsibilities include:Designing and implementing OSS features that make dlt a...


  • Berlin, Berlin, Deutschland dltHub Vollzeit

    About the RoleWe are seeking a skilled Data Engineer to join our team at dltHub. As a key member of our core product team, you will collaborate closely with our CTO to design and implement features that make dlt a gateway to the composable data stack.The ideal candidate will have experience in building data apps or products based on the composable data stack...


  • Berlin, Berlin, Deutschland dltHub Vollzeit

    About dltHubdltHub is a company that specializes in data processing and engineering. We are looking for a skilled engineer to join our team and help us integrate our library, dlt, with the emerging Pythonic Composable Data Stack.Job DescriptionWe are seeking a highly skilled Data Engineer to join our team. As a Data Engineer, you will be responsible for...


  • Berlin, Berlin, Deutschland dltHub Vollzeit

    About dltHubdltHub is a company that specializes in data processing and engineering. We are looking for a skilled engineer to join our team and help us integrate our library, dlt, with the emerging Pythonic Composable Data Stack.Job DescriptionWe are seeking a highly skilled Data Engineer to join our team. As a Data Engineer, you will be responsible for...


  • Berlin, Berlin, Deutschland dltHub Vollzeit

    About the RoleWe are seeking a skilled Data Engineer to join our team at dltHub. As a key member of our core product team, you will collaborate closely with our CTO to design and implement features that make dlt a gateway to the emerging Pythonic Composable Data Stack.Key responsibilities include:Designing and implementing OSS features that integrate query...


  • Berlin, Berlin, Deutschland dltHub Vollzeit

    About UsdltHub is a pioneering company that bridges the gap between the traditional Modern Data Stack and the emerging Pythonic Composable Data Stack. Our mission is to integrate dlt fully with this new ecosystem, making it a seamless gateway for users to process data.Your RoleWe are seeking a skilled Data Engineer to join our core product team. As a key...


  • Berlin, Berlin, Deutschland dltHub Vollzeit

    About UsdltHub is a pioneering company that bridges the gap between the traditional Modern Data Stack and the emerging Pythonic Composable Data Stack. Our mission is to integrate dlt fully with this new ecosystem, making it a seamless gateway for users to process data.Your RoleWe are seeking a skilled Data Engineer to join our core product team. As a key...


  • Berlin, Berlin, Deutschland dltHub Vollzeit

    About dltHubdltHub is a company that specializes in developing open-source data processing libraries, including dlt, a library that automates data engineering tasks and allows users to move data from various sources into SQL and vector stores, data lakes, storage buckets, or local engines.We are looking for a skilled Python Engineer to join our team and...


  • Berlin, Berlin, Deutschland dltHub Vollzeit

    About dltHubdltHub is a company that specializes in developing open-source data processing libraries, including dlt, a library that automates data engineering tasks and allows users to move data from various sources into SQL and vector stores, data lakes, storage buckets, or local engines.We are looking for a skilled Python Engineer to join our team and...


  • Berlin, Berlin, Deutschland dltHub Vollzeit

    About dltHubdltHub is a company that specializes in developing open-source data processing libraries, including dlt, a library that automates data engineering tasks and allows users to move data from various sources into SQL and vector stores, data lakes, storage buckets, or local engines.We are looking for a skilled Python Engineer to join our team and...


  • Berlin, Berlin, Deutschland dltHub Vollzeit

    About dltHubdltHub is a company that specializes in developing open-source data processing libraries, including dlt, a library that automates data engineering tasks and allows users to move data from various sources into SQL and vector stores, data lakes, storage buckets, or local engines.We are looking for a skilled Python Engineer to join our team and...


  • Berlin, Berlin, Deutschland dltHub Vollzeit

    About the RoleWe are seeking a skilled Python Engineer to join our team at dltHub. As a key member of our core product team, you will collaborate closely with our CTO to design and implement features that make dlt a gateway to the composable data stack.dlt is an open-source library that automates data engineering tasks and allows users to move data from...


  • Berlin, Berlin, Deutschland dltHub ScaleVector GmbH Vollzeit

    About the RoleWe are seeking a skilled Composable Data Stack Python Developer to join our team at dltHub / ScaleVector GmbH. As a key member of our core product team, you will collaborate directly with our CTO to design and implement high-performance data processing libraries.Key ResponsibilitiesDesign and implement OSS features that integrate query engines,...

  • Senior Data Engineer

    vor 2 Wochen


    Berlin, Berlin, Deutschland dltHub Vollzeit

    About the RoleWe are seeking a highly skilled Senior Data Engineer to join our team at dltHub. As a key member of our core product team, you will collaborate closely with our CTO to design and implement open-source features that make dlt a gateway to the composable data stack.The ideal candidate will have experience in building data apps or products based on...


  • Berlin, Berlin, Deutschland dltHub ScaleVector GmbH Vollzeit

    Job DescriptionAt dltHub, we're looking for a skilled Composable Data Stack Python Developer to join our team. As a key member of our core product team, you'll collaborate directly with our CTO to design and implement high-performance data processing libraries.Your ResponsibilitiesDesign and implement OSS features that integrate query engines, transformation...

  • Senior Data Engineer

    vor 2 Wochen


    Berlin, Berlin, Deutschland dltHub Vollzeit

    About the RoleWe are seeking a highly skilled Senior Data Engineer to join our team at dltHub. As a key member of our core product team, you will collaborate closely with our CTO to design and implement open-source features that make dlt a gateway to the composable data stack.The ideal candidate will have experience in building data apps or products based on...

  • Senior Data Engineer

    vor 2 Wochen


    Berlin, Berlin, Deutschland dltHub Vollzeit

    About the RoleWe are seeking a highly skilled Senior Software Engineer to join our team at dltHub. As a key member of our core product team, you will collaborate closely with our CTO to design and implement features that make dlt a gateway to the emerging Pythonic Composable Data Stack.The ideal candidate will have experience in building data apps or...

  • Senior Data Engineer

    vor 3 Wochen


    Berlin, Berlin, Deutschland dltHub Vollzeit

    About UsdltHub is a pioneering company that bridges the gap between traditional data stacks and emerging Pythonic data libraries. Our mission is to empower users to seamlessly integrate data processing and storage solutions.Job DescriptionWe are seeking a highly skilled Senior Data Engineer to join our core product team. As a key member, you will collaborate...

  • Senior Data Engineer

    vor 3 Wochen


    Berlin, Berlin, Deutschland dltHub Vollzeit

    About UsdltHub is a pioneering company that bridges the gap between traditional data stacks and emerging Pythonic data libraries. Our mission is to empower users to seamlessly integrate data processing and storage solutions.Job DescriptionWe are seeking a highly skilled Senior Data Engineer to join our core product team. As a key member, you will collaborate...

  • Senior Data Engineer

    vor 2 Wochen


    Berlin, Berlin, Deutschland dltHub Vollzeit

    About the RoleWe are seeking a highly skilled Senior Data Engineer to join our team at dltHub. As a key member of our core product team, you will collaborate closely with our CTO to design and implement features that make dlt a gateway to the emerging Pythonic Composable Data Stack.Key responsibilities include:Designing and implementing open-source features...