Senior Data Engineer

vor 2 Wochen

Frankfurt am Main, Hessen, Deutschland Circunomics Vollzeit
Job Summary

We are seeking a highly skilled Senior Data Engineer to join our team at Circunomics. As a Senior Data Engineer, you will be responsible for designing, developing, and deploying scalable, maintainable, efficient, and reliable applications using Python 3, FastAPI or Flask, with optional use of Angular.

Key Responsibilities
  • End-to-End Development: Design, develop, and deploy scalable applications using Python 3, FastAPI or Flask, with optional use of Angular.
  • Big Data Management: Handle (near) real-time big data environments, managing and processing datasets starting from terabytes with precision and efficiency.
  • ETL Processes: Design, implement, and manage ETL (Extract, Transform, Load) processes to ensure efficient data handling through its entire lifecycle.
  • Performance Optimization: Implement caching services like Redis to improve application performance.
  • Data Pipelines: Develop and manage data pipelines using Airflow.
  • Mentorship: Provide guidance and mentorship to junior developers, fostering a culture of continuous learning and improvement within the team.
  • Architecture & Design: Collaborate with architects and other developers to design robust, high-performance, secure application architectures.
  • Collaboration: Work closely with product managers, designers, and other stakeholders to understand requirements, provide technical insights, and ensure the successful delivery of features.
  • Code Quality & Best Practices: Write clean, efficient, and well-documented code while setting and maintaining high standards for code quality through code reviews, testing, and automated tooling.
  • Containerization: Containerize applications using Docker and manage container orchestration with Kubernetes.
  • Infrastructure Management: Create and manage infrastructure using Helm Charts and Terraform.
  • Cloud Deployment: Deploy and manage applications on AWS cloud platforms, including S3, ECR, EKS, RDS, and EFS.
  • Data Visualization: Create data visualizations using Plotly.
  • CI/CD Implementation: Implement CI/CD pipelines using GitHub.
  • Troubleshooting & Optimization: Troubleshoot and resolve application issues while optimizing performance.
Requirements
  • Experience: You have a minimum of 5 to 7 years of professional experience as a Data Engineer, particularly with Python 3, FastAPI, or Flask, and optional familiarity with Angular.
  • Big Data Management: You possess deep knowledge in managing (near) real-time big data environments, dealing with datasets starting from terabytes.
  • ETL Processes: You are proficient in implementing ETL (Extract, Transform, Load) processes, ensuring effective and efficient data handling throughout its lifecycle.
  • Deep Understanding: You have in-depth knowledge of software development methodologies, RESTful APIs, microservices architecture, and CI/CD pipelines.
  • Problem-solving: You have strong analytical and problem-solving skills and can tackle complex technical challenges.
  • Communication: You have excellent communication and interpersonal skills and can convey complex technical concepts to non-technical stakeholders.
  • Adaptability: You thrive in a fast-paced, dynamic environment and can manage multiple priorities and projects simultaneously.
  • Language Skills: You have a good command of the English language.
  • Nice to Have:
    • Experience with Dash Framework for data visualization.
    • Familiarity with other cloud platforms and technologies.
About Us

Circunomics is a leading company in the circular battery economy, offering a comprehensive battery lifecycle management solution. We are dedicated to establishing a true circular battery economy to maximize each stage of battery life. Our team is passionate about driving green mobility and new energy by optimizing second life and recycling through data.

We are looking for a talented Senior Data Engineer to join our team and contribute to our mission. If you are a motivated and experienced professional with a passion for data engineering, we encourage you to apply.

  • Senior Data Engineer

    vor 2 Wochen

    Frankfurt am Main, Hessen, Deutschland 0010 Deutsche Bank Aktiengesellschaft Vollzeit

    Job DescriptionJob Title: Senior Data EngineerJob Summary: We are seeking a highly skilled Senior Data Engineer to join our team at Deutsche Bank Aktiengesellschaft. As a Senior Data Engineer, you will be responsible for designing, developing, and maintaining large-scale data systems and architectures to support our business operations.Key...

  • Senior Data Engineer

    vor 2 Wochen

    Frankfurt am Main, Hessen, Deutschland 0010 Deutsche Bank Aktiengesellschaft Vollzeit

    Job DescriptionJob Title: Senior Data EngineerJob Summary: We are seeking a highly skilled Senior Data Engineer to join our team at Deutsche Bank Aktiengesellschaft. As a Senior Data Engineer, you will be responsible for designing, developing, and maintaining large-scale data systems and architectures to support our business operations.Key...

  • Senior Data Engineer

    vor 3 Wochen

    Frankfurt am Main, Hessen, Deutschland zeroG GmbH Vollzeit

    Join Our Team as a Senior Data EngineerWe are seeking a highly skilled Senior Data Engineer to join our team at zeroG GmbH. As a Senior Data Engineer, you will play a key role in helping our airline and aviation-related customers transform their business with the power of data.Key Responsibilities:Design and implement modern data infrastructure that enables...

  • Senior Data Engineer

    vor 3 Wochen

    Frankfurt am Main, Hessen, Deutschland zeroG GmbH Vollzeit

    Join Our Team as a Senior Data EngineerWe are seeking a highly skilled Senior Data Engineer to join our team at zeroG GmbH. As a Senior Data Engineer, you will play a key role in helping our airline and aviation-related customers transform their business with the power of data.Key Responsibilities:Design and implement modern data infrastructure that enables...

  • Senior Data Engineer

    vor 4 Wochen

    Frankfurt am Main, Hessen, Deutschland Avantgarde Experts Vollzeit

    Senior Data EngineerWir suchen einen erfahrenen Senior Data Engineer, der unsere Kunden bei der Implementierung von Datenplattformen unterstützt.Hauptraum:Entwicklung und Implementierung von Datenplattformen auf Basis von Azure, Synapse und AWSDesign und Implementierung von Datenmodellen für die Speicherung von DatenImplementierung von ELT-Prozessen (SAP...

  • Senior Data Engineer

    vor 4 Wochen

    Frankfurt am Main, Hessen, Deutschland Avantgarde Experts Vollzeit

    Senior Data EngineerWir suchen einen erfahrenen Senior Data Engineer, der unsere Kunden bei der Implementierung von Datenplattformen unterstützt.Hauptraum:Entwicklung und Implementierung von Datenplattformen auf Basis von Azure, Synapse und AWSDesign und Implementierung von Datenmodellen für die Speicherung von DatenImplementierung von ELT-Prozessen (SAP...

  • Senior Data Engineer

    vor 4 Wochen

    Frankfurt am Main, Hessen, Deutschland 0010 Deutsche Bank Aktiengesellschaft Vollzeit

    Job DescriptionJob Title: Senior Engineer for Data and ReportingJob Summary: Wir suchen einen erfahrenen Senior Engineer für unsere Data and Reporting-Plattform. Als technischer Experte sind Sie verantwortlich für die Leitung eines Ingenieurteams und die Durchführung von Arbeiten auf unserer Daten- und Reporting-Plattform.Key...

  • Senior Data Engineer

    vor 4 Wochen

    Frankfurt am Main, Hessen, Deutschland 0010 Deutsche Bank Aktiengesellschaft Vollzeit

    Job DescriptionJob Title: Senior Engineer for Data and ReportingJob Summary: Wir suchen einen erfahrenen Senior Engineer für unsere Data and Reporting-Plattform. Als technischer Experte sind Sie verantwortlich für die Leitung eines Ingenieurteams und die Durchführung von Arbeiten auf unserer Daten- und Reporting-Plattform.Key...

  • Senior Data Engineer

    vor 16 Stunden

    Frankfurt am Main, Hessen, Deutschland 0010 Deutsche Bank Aktiengesellschaft Vollzeit

    Die RolleDer Senior Engineer für Data and Reporting ist ein wichtiger Teil des Private Bank Data & Analytics Tribe Domains. Wir sind ein Team von Experten, die qualitativ hochwertige Daten und Anwendungen zur Datenaufbereitung für die Privatbank und verschiedene Bereiche der Gruppe liefern.HauptaufgabenAls Senior Engineer für Data and Reporting sind Sie...

  • Senior Data Engineer

    vor 3 Wochen

    Frankfurt am Main, Hessen, Deutschland 0010 Deutsche Bank Aktiengesellschaft Vollzeit

    Job Title: Senior Data EngineerWe are seeking a highly skilled Senior Data Engineer to join our team at Deutsche Bank Aktiengesellschaft. As a key member of our Private Bank Data Platform, you will be responsible for designing, developing, and operating fast and reliable solutions for data warehousing and business intelligence.Your Key...

  • Senior Data Engineer

    vor 3 Wochen

    Frankfurt am Main, Hessen, Deutschland 0010 Deutsche Bank Aktiengesellschaft Vollzeit

    Job Title: Senior Data EngineerWe are seeking a highly skilled Senior Data Engineer to join our team at Deutsche Bank Aktiengesellschaft. As a key member of our Private Bank Data Platform, you will be responsible for designing, developing, and operating fast and reliable solutions for data warehousing and business intelligence.Your Key...

  • Senior Data Engineer

    vor 4 Wochen

    Frankfurt am Main, Hessen, Deutschland RP International Vollzeit

    Senior Data EngineerThe Senior Data Engineer will be responsible for designing, deploying, and maintaining the data pipeline architecture that is essential to our clients analytics and trading platforms. The ideal candidate will bridge the gap between data science and data management, ensuring data is accurate, accessible, and efficiently processed for...

  • Senior Data Engineer

    vor 4 Wochen

    Frankfurt am Main, Hessen, Deutschland RP International Vollzeit

    Senior Data EngineerThe Senior Data Engineer will be responsible for designing, deploying, and maintaining the data pipeline architecture that is essential to our clients analytics and trading platforms. The ideal candidate will bridge the gap between data science and data management, ensuring data is accurate, accessible, and efficiently processed for...

  • Senior Data Engineer

    vor 4 Wochen

    Frankfurt am Main, Hessen, Deutschland SymBio. Vollzeit

    Über unsSymBio ist ein Unternehmen, das sich auf die Suche nach Fach- und Führungskräften im IT-Umfeld spezialisiert hat.JobbeschreibungWir suchen einen Senior Data Engineer, der unsere Kunden deutschlandweit bei der Suche nach Fach- und Führungskräften im IT-Umfeld unterstützt.AufgabenDas Entwicklungs Team durch Analysen, Simulationen und andere...

  • Senior Data Engineer

    vor 4 Wochen

    Frankfurt am Main, Hessen, Deutschland SymBio. Vollzeit

    Über unsSymBio ist ein Unternehmen, das sich auf die Suche nach Fach- und Führungskräften im IT-Umfeld spezialisiert hat.JobbeschreibungWir suchen einen Senior Data Engineer, der unsere Kunden deutschlandweit bei der Suche nach Fach- und Führungskräften im IT-Umfeld unterstützt.AufgabenDas Entwicklungs Team durch Analysen, Simulationen und andere...

  • Senior Data Engineer

    vor 2 Wochen

    Frankfurt am Main, Hessen, Deutschland 0010 Deutsche Bank Aktiengesellschaft Vollzeit

    Job Title: Senior Data EngineerWe are seeking a highly skilled Senior Data Engineer to join our team at Deutsche Bank Aktiengesellschaft. As a key member of our Private Bank Data Platform, you will be responsible for designing, developing, and operating fast and reliable solutions for data warehousing and business intelligence.Your Key...

  • Senior Data Engineer

    vor 2 Wochen

    Frankfurt am Main, Hessen, Deutschland 0010 Deutsche Bank Aktiengesellschaft Vollzeit

    Job Title: Senior Data EngineerWe are seeking a highly skilled Senior Data Engineer to join our team at Deutsche Bank Aktiengesellschaft. As a key member of our Private Bank Data Platform, you will be responsible for designing, developing, and operating fast and reliable solutions for data warehousing and business intelligence.Your Key...

  • Senior Data Engineer

    vor 4 Wochen

    Frankfurt am Main, Hessen, Deutschland 0010 Deutsche Bank Aktiengesellschaft Vollzeit

    Job Title: Senior Data EngineerWe are seeking a highly skilled Senior Data Engineer to join our team at Deutsche Bank Aktiengesellschaft. As a key member of our Private Bank Data Platform, you will be responsible for designing, developing, and operating fast and reliable solutions for data warehousing and business intelligence.Your Key...

  • Senior Data Engineer

    vor 4 Wochen

    Frankfurt am Main, Hessen, Deutschland 0010 Deutsche Bank Aktiengesellschaft Vollzeit

    Job Title: Senior Data EngineerWe are seeking a highly skilled Senior Data Engineer to join our team at Deutsche Bank Aktiengesellschaft. As a key member of our Private Bank Data Platform, you will be responsible for designing, developing, and operating fast and reliable solutions for data warehousing and business intelligence.Your Key...

  • Senior Cloud Data Engineer

    vor 4 Wochen

    Frankfurt am Main, Hessen, Deutschland INFOMOTION GmbH Vollzeit

    Senior Cloud Data EngineerWir suchen einen erfahrenen Senior Cloud Data Engineer, der sich auf die Integration und Architektur von Daten in der Cloud spezialisiert hat. Als Teil unseres Teams werden Sie maßgeschneiderte Lösungen für unsere Kunden entwickeln und implementieren.Verantwortlichkeiten:Entwicklung von Datenpipelines für die effektive...