Senior Data Engineer — Scalable Solutions

vor 1 Monat


Frankfurt am Main, Hessen, Deutschland Next Mobility Labs Circunomics Airive Vollzeit
About the Role

We are seeking a highly skilled Data Engineer to join our team at Next Mobility Labs // Circunomics // Airive. As a key member of our engineering team, you will be responsible for designing, developing, and deploying scalable, maintainable, and efficient applications using Python 3, FastAPI or Flask, with optional use of Angular.

Key Responsibilities
  • Design and implement end-to-end development processes to ensure seamless integration of back-end components.
  • Manage and process large datasets in (near) real-time big data environments, ensuring precision and efficiency.
  • Develop and manage ETL (Extract, Transform, Load) processes to handle data efficiently throughout its lifecycle.
  • Implement caching services like Redis to improve application performance.
  • Develop and manage data pipelines using Airflow.
  • Provide guidance and mentorship to junior developers, fostering a culture of continuous learning and improvement within the team.
  • Collaborate with architects and other developers to design robust, high-performance, secure application architectures.
  • Work closely with product managers, designers, and other stakeholders to understand requirements, provide technical insights, and ensure the successful delivery of features.
  • Write clean, efficient, and well-documented code while setting and maintaining high standards for code quality through code reviews, testing, and automated tooling.
  • Containerize applications using Docker and manage container orchestration with Kubernetes.
  • Create and manage infrastructure using Helm Charts and Terraform.
  • Deploy and manage applications on AWS cloud platforms, including S3, ECR, EKS, RDS, and EFS.
  • Create data visualizations using Plotly.
  • Implement CI/CD pipelines using GitHub.
  • Troubleshoot and resolve application issues while optimizing performance.
Requirements
  • Minimum 5 to 7 years of professional experience as a Data Engineer, particularly with Python 3, FastAPI, or Flask, and optional familiarity with Angular.
  • Deep knowledge in managing (near) real-time big data environments, dealing with datasets starting from terabytes.
  • Proficiency in implementing ETL (Extract, Transform, Load) processes, ensuring effective and efficient data handling throughout its lifecycle.
  • Strong analytical and problem-solving skills and ability to tackle complex technical challenges.
  • Excellent communication and interpersonal skills and ability to convey complex technical concepts to non-technical stakeholders.
  • Ability to thrive in a fast-paced, dynamic environment and manage multiple priorities and projects simultaneously.
  • Good command of the English language.
What We Offer
  • Flexible hours.
  • Work-from-home options.
  • Low hierarchies and open feedback culture.
  • Open & international environment.
  • Modern offices are in the city center of Frankfurt.
  • English is the company language and is used in international working environments.
  • Attractive development perspectives with creative freedom for growth.
  • Shape the future circular battery space and the green energy transition.


  • Frankfurt am Main, Hessen, Deutschland Circunomics Vollzeit

    Job SummaryWe are seeking a highly skilled Senior Data Engineer to join our team at Circunomics. As a key member of our engineering team, you will be responsible for designing, developing, and deploying scalable, maintainable, and efficient applications using Python 3, FastAPI, or Flask. Your expertise in big data management, ETL processes, and data...


  • Frankfurt am Main, Hessen, Deutschland Circunomics Vollzeit

    Job SummaryWe are seeking a highly skilled Senior Data Engineer to join our team at Circunomics. As a key member of our engineering team, you will be responsible for designing, developing, and deploying scalable, maintainable, and efficient applications using Python 3, FastAPI, or Flask. Your expertise in big data management, ETL processes, and data...


  • Frankfurt am Main, Hessen, Deutschland Circunomics Vollzeit

    Unlock the Power of Data EngineeringCircunomics is seeking a highly skilled Data Engineer to join our team and contribute to the development of scalable, maintainable, and efficient applications. As a key member of our engineering team, you will design, develop, and deploy cutting-edge solutions using Python 3, FastAPI, and Flask.Key...


  • Frankfurt am Main, Hessen, Deutschland Circunomics Vollzeit

    Unlock the Power of Data EngineeringCircunomics is seeking a highly skilled Data Engineer to join our team and contribute to the development of scalable, maintainable, and efficient applications. As a key member of our engineering team, you will design, develop, and deploy cutting-edge solutions using Python 3, FastAPI, and Flask.Key...


  • Frankfurt am Main, Hessen, Deutschland Circunomics Vollzeit

    Your MissionWe are seeking a highly skilled Senior Data Engineer to join our team at Circunomics. As a key member of our engineering team, you will be responsible for designing, developing, and deploying scalable, maintainable, efficient, and reliable applications using Python 3, FastAPI or Flask, with optional use of Angular.Key ResponsibilitiesEnd-to-End...


  • Frankfurt am Main, Hessen, Deutschland Circunomics Vollzeit

    About the RoleWe are seeking a highly skilled Data Engineer to join our team at Circunomics. As a Data Engineer, you will be responsible for designing, developing, and deploying scalable applications using Python 3, FastAPI, or Flask, with optional use of Angular. You will also be responsible for managing and processing big data environments, implementing...


  • Frankfurt am Main, Hessen, Deutschland Circunomics Vollzeit

    Key ResponsibilitiesDesign and Develop Scalable Applications: Utilize Python 3, FastAPI, or Flask to create efficient, maintainable, and reliable applications, ensuring seamless integration of back-end components.Manage Big Data Environments: Handle (near) real-time big data environments, processing datasets starting from terabytes with precision and...


  • Frankfurt am Main, Hessen, Deutschland Next Mobility Labs Circunomics Airive Vollzeit

    About the RoleWe are seeking a highly skilled Data Engineer to join our team at Next Mobility Labs // Circunomics // Airive. As a key member of our engineering team, you will be responsible for designing, developing, and deploying scalable, maintainable, and efficient applications using Python 3, FastAPI or Flask, with optional use of Angular.Key...


  • Frankfurt am Main, Hessen, Deutschland Next Mobility Labs Circunomics Airive Vollzeit

    About the RoleWe are seeking a highly skilled Data Engineer to join our team at Next Mobility Labs // Circunomics // Airive. As a key member of our engineering team, you will be responsible for designing, developing, and deploying scalable, maintainable, and efficient applications using Python 3, FastAPI or Flask, with optional use of Angular.Key...


  • Frankfurt am Main, Hessen, Deutschland Next Mobility Labs Circunomics Airive Vollzeit

    About the RoleWe are seeking a highly skilled Data Engineer to join our team at Next Mobility Labs // Circunomics // Airive. As a key member of our engineering team, you will be responsible for designing, developing, and deploying scalable, maintainable, and efficient applications using Python 3, FastAPI or Flask, with optional use of Angular.Key...


  • Frankfurt am Main, Hessen, Deutschland Next Mobility Labs Circunomics Airive Vollzeit

    About the RoleWe are seeking a highly skilled Data Engineer to join our team at Next Mobility Labs // Circunomics // Airive. As a key member of our engineering team, you will be responsible for designing, developing, and deploying scalable, maintainable, and efficient applications using Python 3, FastAPI or Flask, with optional use of Angular.Key...


  • Frankfurt am Main, Hessen, Deutschland Next Mobility Labs Circunomics Airive Vollzeit

    About the RoleWe are seeking a highly skilled Data Engineer to join our team at Next Mobility Labs // Circunomics // Airive. As a Data Engineer, you will play a critical role in designing, developing, and deploying scalable, maintainable, efficient, and reliable applications using Python 3, FastAPI or Flask, with optional use of Angular.Key...


  • Frankfurt am Main, Hessen, Deutschland Next Mobility Labs Circunomics Airive Vollzeit

    About the RoleWe are seeking a highly skilled Data Engineer to join our team at Next Mobility Labs // Circunomics // Airive. As a Data Engineer, you will play a critical role in designing, developing, and deploying scalable, maintainable, efficient, and reliable applications using Python 3, FastAPI or Flask, with optional use of Angular.Key...


  • Frankfurt am Main, Hessen, Deutschland Circunomics Vollzeit

    About the RoleWe are seeking a highly skilled Data Engineer to join our team at Circunomics. As a key member of our engineering team, you will be responsible for designing, developing, and deploying scalable, maintainable, efficient, and reliable applications using Python 3, FastAPI or Flask, with optional use of Angular.Key Responsibilities:Design, develop,...


  • Frankfurt am Main, Hessen, Deutschland Next Mobility Labs Circunomics Airive Vollzeit

    {"h3": "Mission Overview"} Design and deploy scalable, maintainable, and efficient applications using Python 3, FastAPI, or Flask, with optional use of Angular, ensuring seamless integration of back-end components. Manage and process large datasets in (near) real-time big data environments, handling terabytes of data with precision and efficiency. Implement...


  • Frankfurt am Main, Hessen, Deutschland Next Mobility Labs Circunomics Airive Vollzeit

    {"h3": "Mission Overview"} Design and deploy scalable, maintainable, and efficient applications using Python 3, FastAPI, or Flask, with optional use of Angular, ensuring seamless integration of back-end components. Manage and process large datasets in (near) real-time big data environments, handling terabytes of data with precision and efficiency. Implement...


  • Frankfurt am Main, Hessen, Deutschland Next Mobility Labs Circunomics Airive Vollzeit

    About the RoleWe are seeking a highly skilled Senior Data Engineer to join our team at Next Mobility Labs // Circunomics // Airive. As a key member of our engineering team, you will be responsible for designing, developing, and deploying scalable, maintainable, efficient, and reliable applications using Python 3, FastAPI or Flask, with optional use of...

  • Senior Data Engineer

    vor 4 Wochen


    Frankfurt am Main, Hessen, Deutschland RP International Vollzeit

    Senior Data EngineerThe Senior Data Engineer will be responsible for designing, deploying, and maintaining the data pipeline architecture that is essential to our clients analytics and trading platforms. The ideal candidate will bridge the gap between data science and data management, ensuring data is accurate, accessible, and efficiently processed for...

  • Senior Data Engineer

    vor 4 Wochen


    Frankfurt am Main, Hessen, Deutschland RP International Vollzeit

    Senior Data EngineerThe Senior Data Engineer will be responsible for designing, deploying, and maintaining the data pipeline architecture that is essential to our clients analytics and trading platforms. The ideal candidate will bridge the gap between data science and data management, ensuring data is accurate, accessible, and efficiently processed for...

  • Senior Data Engineer

    vor 2 Wochen


    Frankfurt am Main, Hessen, Deutschland Circunomics Vollzeit

    About the RoleWe are seeking a highly skilled Senior Data Engineer to join our team at Circunomics. As a Senior Data Engineer, you will be responsible for designing, developing, and deploying scalable, maintainable, efficient, and reliable applications using Python 3, FastAPI or Flask, with optional use of Angular.Key ResponsibilitiesEnd-to-End Development:...