Data Pipeline Engineer

vor 2 Monaten

Frankfurt am Main, Hessen, Deutschland zeroG GmbH Vollzeit

About the Role

We are seeking a highly skilled Data Engineer to join our team at zeroG GmbH. As a Data Engineer, you will play a crucial role in helping our airline and aviation-related customers transform their business with the power of data.

Key Responsibilities

  • Design and implement modern data infrastructure that enables our data scientists to perform agile data exploration and research.
  • Automate the extraction, loading, and transformation of data from various sources to support business intelligence and analytics.
  • Engineer large, distributed data sets that are built for a specific purpose, such as extracting complex model features from streaming data or aggregating years' worth of data in a business intelligence dashboard.
  • Transform data science prototypes into production-ready products by developing battle-tested pipelines.
  • Collaborate with customers to understand their business needs, identify key metrics, and define data requirements.
  • Advise customers on how to improve data quality and governance.

Requirements

  • A Bachelor's or Master's degree in Computer Science, Software Engineering, or a related field.
  • Experience in building data sets and pipelines for analytical use cases.
  • Proficiency in Python, SQL, and Docker.
  • Solid knowledge of building and optimizing data lakes, distributed datasets, and data pipelines, especially in Apache Spark.
  • Technical understanding of meeting non-functional requirements, including query performance, data quality, and security.
  • A passion for building sophisticated technical solutions and a willingness to learn.

Desirable Skills

  • Message queueing and streaming systems, such as Apache Kafka.
  • Scripting and programming languages, such as Scala, Java, or JavaScript.
  • Data mining tools and languages, such as SAS or R.
  • Container orchestration frameworks, such as Kubernetes.
  • Business intelligence tools, such as Tableau or Power BI.
  • Cloud environments, such as Amazon Web Services or Google Cloud Platform.
  • Knowledge of the aviation industry.

  • Senior Data Engineer

    vor 1 Woche

    Frankfurt am Main, Hessen, Deutschland The chapter Technology & Engineering - Data & A Vollzeit

    About the roleThe chapter Technology & Engineering - Data & AI Engineering is seeking a highly skilled Data Engineer to join our team. As a Data Engineer, you will be responsible for designing, building, and maintaining large-scale data pipelines using cloud-based technologies.Key ResponsibilitiesDesign and implement data sharing interfaces and connectors to...

  • Data Engineer

    vor 2 Wochen

    Frankfurt am Main, Hessen, Deutschland 360T Vollzeit

    Job Title: Data EngineerAt 360T, we are seeking a highly skilled Data Engineer to join our team. As a Data Engineer, you will be responsible for designing, developing, and maintaining large-scale data pipelines and architectures.Responsibilities:Design and implement data pipelines using Kafka, Flink/Spark, and HBaseDevelop and maintain data warehouses and...

  • Data Engineer

    Vor 5 Tagen

    Frankfurt am Main, Hessen, Deutschland 360T Vollzeit

    Data Engineering RoleWe are seeking a skilled Data Engineer to join our team at 360T. As a Data Engineer, you will be responsible for the development and maintenance of our data pipelines, ensuring seamless data flow and high-quality data warehousing infrastructure.Key ResponsibilitiesDesign, implement, and maintain data pipelines to support our data...

  • Data Engineer

    vor 1 Woche

    Frankfurt am Main, Hessen, Deutschland 360T Vollzeit

    About the RoleWe are seeking a highly skilled Data Engineer to join our team at 360T. As a Data Engineer, you will be responsible for designing, developing, and maintaining our data pipelines and infrastructure.Key ResponsibilitiesParticipate in the development and maintenance of data pipelinesWork on data modeling, ETL processes, and data transformation...

  • Senior Data Engineer

    vor 2 Wochen

    Frankfurt am Main, Hessen, Deutschland The chapter Technology & Engineering - Data & A Vollzeit

    About the roleThe chapter Technology & Engineering - Data & AI Engineering is seeking a skilled Data Engineer to join our team. As a Data Engineer, you will be responsible for designing, building, and maintaining large-scale data pipelines using cloud-based technologies such as AWS and Azure.Key responsibilitiesDesign and implement data sharing interfaces...

  • Senior Data Engineer

    Vor 6 Tagen

    Frankfurt am Main, Hessen, Deutschland The chapter Technology & Engineering - Data & A Vollzeit

    About the roleThe chapter Technology & Engineering - Data & AI Engineering is seeking a skilled Data Engineer to join their team. As a Data Engineer, you will be responsible for designing, building, and maintaining large-scale data pipelines using cloud-based technologies such as AWS and Azure.Key responsibilitiesDesign and implement data sharing interfaces...

  • Data Engineer

    vor 1 Monat

    Frankfurt am Main, Hessen, Deutschland Alexander Thamm GmbH Vollzeit

    JobbeschreibungWir suchen einen erfahrenen Data Engineer, der sich auf die Konzeptionierung und den Aufbau von Big Data/Analytics-Plattformen spezialisiert hat. Der Kandidat sollte Erfahrung in der Auswahl geeigneter Technologien für die Umsetzung von Data Analytics-Use Cases haben und in der Lage sein, Daten-Pipelines auf Cluster-Architekturen zu...

  • Data Engineer

    vor 1 Monat

    Frankfurt am Main, Hessen, Deutschland Alexander Thamm GmbH Vollzeit

    JobbeschreibungWir suchen einen erfahrenen Data Engineer, der sich auf die Konzeptionierung und den Aufbau von Big Data/Analytics-Plattformen spezialisiert hat. Der Kandidat sollte Erfahrung in der Auswahl geeigneter Technologien für die Umsetzung von Data Analytics-Use Cases haben und in der Lage sein, Daten-Pipelines auf Cluster-Architekturen zu...

  • Senior Data Engineer

    vor 4 Wochen

    Frankfurt am Main, Hessen, Deutschland RP International Vollzeit

    Senior Data EngineerThe Senior Data Engineer will be responsible for designing, deploying, and maintaining the data pipeline architecture that is essential to our clients analytics and trading platforms. The ideal candidate will bridge the gap between data science and data management, ensuring data is accurate, accessible, and efficiently processed for...

  • Senior Data Engineer

    vor 4 Wochen

    Frankfurt am Main, Hessen, Deutschland RP International Vollzeit

    Senior Data EngineerThe Senior Data Engineer will be responsible for designing, deploying, and maintaining the data pipeline architecture that is essential to our clients analytics and trading platforms. The ideal candidate will bridge the gap between data science and data management, ensuring data is accurate, accessible, and efficiently processed for...

  • Senior Data Engineer

    vor 3 Wochen

    Frankfurt am Main, Hessen, Deutschland Alexander Thamm GmbH Vollzeit

    JobbeschreibungWir suchen einen erfahrenen Data Engineer, der sich auf die Konzeptionierung und Umsetzung von Big Data-Analytics-Plattformen spezialisiert hat.AufgabenKonzeptionierung und Aufbau von Big Data-Analytics-PlattformenAuswahl von geeigneten Technologien für die Umsetzung von Data-Analytics-Use-CasesEntwicklung, Ausführung und Skalierung von...

  • Senior Data Engineer

    vor 3 Wochen

    Frankfurt am Main, Hessen, Deutschland Alexander Thamm GmbH Vollzeit

    JobbeschreibungWir suchen einen erfahrenen Data Engineer, der sich auf die Konzeptionierung und Umsetzung von Big Data-Analytics-Plattformen spezialisiert hat.AufgabenKonzeptionierung und Aufbau von Big Data-Analytics-PlattformenAuswahl von geeigneten Technologien für die Umsetzung von Data-Analytics-Use-CasesEntwicklung, Ausführung und Skalierung von...

  • Data Engineer

    vor 3 Wochen

    Frankfurt am Main, Hessen, Deutschland Alexander Thamm GmbH Vollzeit

    JobbeschreibungWir suchen einen erfahrenen Data Engineer, der sich auf die Konzeptionierung und den Aufbau von Big Data/Analytics-Plattformen spezialisiert hat. Der Kandidat sollte Erfahrung in der Auswahl geeigneter Technologien für die Umsetzung von Data Analytics-Use Cases haben und in der Lage sein, Daten-Pipelines auf Cluster-Architekturen zu...

  • Data Engineer

    vor 3 Wochen

    Frankfurt am Main, Hessen, Deutschland Alexander Thamm GmbH Vollzeit

    JobbeschreibungWir suchen einen erfahrenen Data Engineer, der sich auf die Konzeptionierung und den Aufbau von Big Data/Analytics-Plattformen spezialisiert hat. Der Kandidat sollte Erfahrung in der Auswahl geeigneter Technologien für die Umsetzung von Data Analytics-Use Cases haben und in der Lage sein, Daten-Pipelines auf Cluster-Architekturen zu...

  • Data Engineer

    vor 3 Wochen

    Frankfurt am Main, Hessen, Deutschland SDX Vollzeit

    Join Our Team of Data EngineersWe are looking for a highly skilled Data Engineer to join our team at SDX. As a Data Engineer, you will be responsible for designing, developing, and maintaining large-scale data systems and architectures.Key ResponsibilitiesDesign and implement data pipelines using Azure Data Factory, Azure Synapse, and DatabricksDevelop and...

  • Data Engineer

    vor 3 Wochen

    Frankfurt am Main, Hessen, Deutschland SDX Vollzeit

    Join Our Team of Data EngineersWe are looking for a highly skilled Data Engineer to join our team at SDX. As a Data Engineer, you will be responsible for designing, developing, and maintaining large-scale data systems and architectures.Key ResponsibilitiesDesign and implement data pipelines using Azure Data Factory, Azure Synapse, and DatabricksDevelop and...

  • Senior Data Engineer

    vor 4 Wochen

    Frankfurt am Main, Hessen, Deutschland zeroG GmbH Vollzeit

    Join Our Team as a Senior Data EngineerWe are seeking a highly skilled Senior Data Engineer to join our team at zeroG GmbH. As a Senior Data Engineer, you will play a key role in helping our airline and aviation-related customers transform their business with the power of data.Key Responsibilities:Design and implement modern data infrastructure that enables...

  • Senior Data Engineer

    vor 4 Wochen

    Frankfurt am Main, Hessen, Deutschland zeroG GmbH Vollzeit

    Join Our Team as a Senior Data EngineerWe are seeking a highly skilled Senior Data Engineer to join our team at zeroG GmbH. As a Senior Data Engineer, you will play a key role in helping our airline and aviation-related customers transform their business with the power of data.Key Responsibilities:Design and implement modern data infrastructure that enables...

  • Data Engineer

    vor 4 Wochen

    Frankfurt am Main, Hessen, Deutschland Alexander Thamm GmbH Vollzeit

    JobbeschreibungWir suchen einen erfahrenen Data Engineer, der sich auf die Konzeptionierung und den Aufbau von Big Data/Analytics-Plattformen spezialisiert hat. Der Kandidat sollte Erfahrung in der Auswahl geeigneter Technologien für die Umsetzung von Data Analytics-Use Cases haben und in der Lage sein, Daten-Pipelines auf Cluster-Architekturen zu...

  • Data Engineer

    vor 4 Wochen

    Frankfurt am Main, Hessen, Deutschland Alexander Thamm GmbH Vollzeit

    JobbeschreibungWir suchen einen erfahrenen Data Engineer, der sich auf die Konzeptionierung und den Aufbau von Big Data/Analytics-Plattformen spezialisiert hat. Der Kandidat sollte Erfahrung in der Auswahl geeigneter Technologien für die Umsetzung von Data Analytics-Use Cases haben und in der Lage sein, Daten-Pipelines auf Cluster-Architekturen zu...