Senior Data Engineer — Scalable Solutions

vor 2 Monaten

Frankfurt am Main, Hessen, Deutschland Next Mobility Labs Circunomics Airive Vollzeit
About the Role

We are seeking a highly skilled Data Engineer to join our team at Next Mobility Labs // Circunomics // Airive. As a key member of our engineering team, you will be responsible for designing, developing, and deploying scalable, maintainable, and efficient applications using Python 3, FastAPI or Flask, with optional use of Angular.

Key Responsibilities
  • End-to-End Development: Design, develop, and deploy scalable applications using Python 3, FastAPI or Flask, with optional use of Angular. Ensure seamless integration of back-end components.
  • Big Data Management: Handle (near) real-time big data environments, managing and processing datasets starting from terabytes with precision and efficiency.
  • ETL Processes: Design, implement, and manage ETL (Extract, Transform, Load) processes to ensure efficient data handling through its entire lifecycle.
  • Performance Optimization: Implement caching services like Redis to improve application performance.
  • Data Pipelines: Develop and manage data pipelines using Airflow.
  • Mentorship: Provide guidance and mentorship to junior developers, fostering a culture of continuous learning and improvement within the team.
  • Architecture & Design: Collaborate with architects and other developers to design robust, high-performance, secure application architectures.
  • Collaboration: Work closely with product managers, designers, and other stakeholders to understand requirements, provide technical insights, and ensure the successful delivery of features.
  • Code Quality & Best Practices: Write clean, efficient, and well-documented code while setting and maintaining high standards for code quality through code reviews, testing, and automated tooling.
  • Containerization: Containerize applications using Docker and manage container orchestration with Kubernetes.
  • Infrastructure Management: Create and manage infrastructure using Helm Charts and Terraform.
  • Cloud Deployment: Deploy and manage applications on AWS cloud platforms, including S3, ECR, EKS, RDS, and EFS.
  • Data Visualization: Create data visualizations using Plotly.
  • CI/CD Implementation: Implement CI/CD pipelines using GitHub.
  • Troubleshooting & Optimization: Troubleshoot and resolve application issues while optimizing performance.
Requirements
  • Experience: You have a minimum of 5 to 7 years of professional experience as a Data Engineer, particularly with Python 3, FastAPI, or Flask, and optional familiarity with Angular.
  • Big Data Management: You possess deep knowledge in managing (near) real-time big data environments, dealing with datasets starting from terabytes.
  • ETL Processes: You are proficient in implementing ETL (Extract, Transform, Load) processes, ensuring effective and efficient data handling throughout its lifecycle.
  • Deep Understanding: You have in-depth knowledge of software development methodologies, RESTful APIs, microservices architecture, and CI/CD pipelines.
  • Problem-solving: You have strong analytical and problem-solving skills and can tackle complex technical challenges.
  • Communication: You have excellent communication and interpersonal skills and can convey complex technical concepts to non-technical stakeholders.
  • Adaptability: You thrive in a fast-paced, dynamic environment and can manage multiple priorities and projects simultaneously.
  • Language Skills: You have a good command of the English language.
  • Nice to Have:
    • Experience with Dash Framework for data visualization.
    • Familiarity with other cloud platforms and technologies.

  • Senior Data Engineer — Scalable Solutions

    vor 3 Wochen

    Frankfurt am Main, Hessen, Deutschland Circunomics Vollzeit

    Job SummaryWe are seeking a highly skilled Senior Data Engineer to join our team at Circunomics. As a key member of our engineering team, you will be responsible for designing, developing, and deploying scalable, maintainable, and efficient applications using Python 3, FastAPI, or Flask. Your expertise in big data management, ETL processes, and data...

  • Senior Data Engineer — Scalable Solutions

    vor 3 Wochen

    Frankfurt am Main, Hessen, Deutschland Circunomics Vollzeit

    Job SummaryWe are seeking a highly skilled Senior Data Engineer to join our team at Circunomics. As a key member of our engineering team, you will be responsible for designing, developing, and deploying scalable, maintainable, and efficient applications using Python 3, FastAPI, or Flask. Your expertise in big data management, ETL processes, and data...

  • Senior Data Engineer — Scalable Solutions

    vor 1 Monat

    Frankfurt am Main, Hessen, Deutschland Circunomics Vollzeit

    Unlock the Power of Data EngineeringCircunomics is seeking a highly skilled Data Engineer to join our team and contribute to the development of scalable, maintainable, and efficient applications. As a key member of our engineering team, you will design, develop, and deploy cutting-edge solutions using Python 3, FastAPI, and Flask.Key...

  • Senior Data Engineer — Scalable Solutions

    vor 1 Monat

    Frankfurt am Main, Hessen, Deutschland Circunomics Vollzeit

    Unlock the Power of Data EngineeringCircunomics is seeking a highly skilled Data Engineer to join our team and contribute to the development of scalable, maintainable, and efficient applications. As a key member of our engineering team, you will design, develop, and deploy cutting-edge solutions using Python 3, FastAPI, and Flask.Key...

  • Senior Data Engineer — Scalable Solutions

    vor 1 Woche

    Frankfurt am Main, Hessen, Deutschland Circunomics Vollzeit

    Your MissionWe are seeking a highly skilled Senior Data Engineer to join our team at Circunomics. As a key member of our engineering team, you will be responsible for designing, developing, and deploying scalable, maintainable, efficient, and reliable applications using Python 3, FastAPI or Flask, with optional use of Angular.Key ResponsibilitiesEnd-to-End...

  • Senior Data Engineer — Scalable Applications

    vor 1 Woche

    Frankfurt am Main, Hessen, Deutschland Circunomics Vollzeit

    About the RoleWe are seeking a highly skilled Data Engineer to join our team at Circunomics. As a Data Engineer, you will be responsible for designing, developing, and deploying scalable applications using Python 3, FastAPI, or Flask, with optional use of Angular. You will also be responsible for managing and processing big data environments, implementing...

  • Senior Data Engineer — Scalable Solutions Expert

    Vor 2 Tagen

    Frankfurt am Main, Hessen, Deutschland Circunomics Vollzeit

    Key ResponsibilitiesDesign and Develop Scalable Applications: Utilize Python 3, FastAPI, or Flask to create efficient, maintainable, and reliable applications, ensuring seamless integration of back-end components.Manage Big Data Environments: Handle (near) real-time big data environments, processing datasets starting from terabytes with precision and...

  • Senior Data Engineer — Scalable Solutions

    vor 2 Monaten

    Frankfurt am Main, Hessen, Deutschland Next Mobility Labs Circunomics Airive Vollzeit

    About the RoleWe are seeking a highly skilled Data Engineer to join our team at Next Mobility Labs // Circunomics // Airive. As a key member of our engineering team, you will be responsible for designing, developing, and deploying scalable, maintainable, and efficient applications using Python 3, FastAPI or Flask, with optional use of Angular.Key...

  • Senior Data Engineer — Scalable Solutions

    vor 2 Monaten

    Frankfurt am Main, Hessen, Deutschland Next Mobility Labs Circunomics Airive Vollzeit

    About the RoleWe are seeking a highly skilled Data Engineer to join our team at Next Mobility Labs // Circunomics // Airive. As a key member of our engineering team, you will be responsible for designing, developing, and deploying scalable, maintainable, and efficient applications using Python 3, FastAPI or Flask, with optional use of Angular.Key...

  • Data Engineer — Scalable Solutions

    vor 2 Monaten

    Frankfurt am Main, Hessen, Deutschland Next Mobility Labs Circunomics Airive Vollzeit

    About the RoleWe are seeking a highly skilled Data Engineer to join our team at Next Mobility Labs // Circunomics // Airive. As a Data Engineer, you will play a critical role in designing, developing, and deploying scalable, maintainable, efficient, and reliable applications using Python 3, FastAPI or Flask, with optional use of Angular.Key...

  • Data Engineer — Scalable Solutions

    vor 2 Monaten

    Frankfurt am Main, Hessen, Deutschland Next Mobility Labs Circunomics Airive Vollzeit

    About the RoleWe are seeking a highly skilled Data Engineer to join our team at Next Mobility Labs // Circunomics // Airive. As a Data Engineer, you will play a critical role in designing, developing, and deploying scalable, maintainable, efficient, and reliable applications using Python 3, FastAPI or Flask, with optional use of Angular.Key...

  • Senior Data Engineer — Scalable Solutions

    vor 1 Monat

    Frankfurt am Main, Hessen, Deutschland Next Mobility Labs Circunomics Airive Vollzeit

    About the RoleWe are seeking a highly skilled Data Engineer to join our team at Next Mobility Labs // Circunomics // Airive. As a key member of our engineering team, you will be responsible for designing, developing, and deploying scalable, maintainable, and efficient applications using Python 3, FastAPI or Flask, with optional use of Angular.Key...

  • Senior Data Engineer — Scalable Solutions

    vor 1 Monat

    Frankfurt am Main, Hessen, Deutschland Next Mobility Labs Circunomics Airive Vollzeit

    About the RoleWe are seeking a highly skilled Data Engineer to join our team at Next Mobility Labs // Circunomics // Airive. As a key member of our engineering team, you will be responsible for designing, developing, and deploying scalable, maintainable, and efficient applications using Python 3, FastAPI or Flask, with optional use of Angular.Key...

  • Senior Data Engineer — Scalable Applications Expert

    Vor 5 Tagen

    Frankfurt am Main, Hessen, Deutschland Circunomics Vollzeit

    About the RoleWe are seeking a highly skilled Data Engineer to join our team at Circunomics. As a key member of our engineering team, you will be responsible for designing, developing, and deploying scalable, maintainable, efficient, and reliable applications using Python 3, FastAPI or Flask, with optional use of Angular.Key Responsibilities:Design, develop,...

  • Senior Data Engineer — Scalable Solutions

    vor 1 Monat

    Frankfurt am Main, Hessen, Deutschland Next Mobility Labs Circunomics Airive Vollzeit

    {"h3": "Mission Overview"} Design and deploy scalable, maintainable, and efficient applications using Python 3, FastAPI, or Flask, with optional use of Angular, ensuring seamless integration of back-end components. Manage and process large datasets in (near) real-time big data environments, handling terabytes of data with precision and efficiency. Implement...

  • Senior Data Engineer — Scalable Solutions

    vor 1 Monat

    Frankfurt am Main, Hessen, Deutschland Next Mobility Labs Circunomics Airive Vollzeit

    {"h3": "Mission Overview"} Design and deploy scalable, maintainable, and efficient applications using Python 3, FastAPI, or Flask, with optional use of Angular, ensuring seamless integration of back-end components. Manage and process large datasets in (near) real-time big data environments, handling terabytes of data with precision and efficiency. Implement...

  • Senior Data Engineer — Scalable Applications

    vor 1 Woche

    Frankfurt am Main, Hessen, Deutschland Next Mobility Labs Circunomics Airive Vollzeit

    About the RoleWe are seeking a highly skilled Senior Data Engineer to join our team at Next Mobility Labs // Circunomics // Airive. As a key member of our engineering team, you will be responsible for designing, developing, and deploying scalable, maintainable, efficient, and reliable applications using Python 3, FastAPI or Flask, with optional use of...

  • Senior Data Engineer

    vor 4 Wochen

    Frankfurt am Main, Hessen, Deutschland RP International Vollzeit

    Senior Data EngineerThe Senior Data Engineer will be responsible for designing, deploying, and maintaining the data pipeline architecture that is essential to our clients analytics and trading platforms. The ideal candidate will bridge the gap between data science and data management, ensuring data is accurate, accessible, and efficiently processed for...

  • Senior Data Engineer

    vor 4 Wochen

    Frankfurt am Main, Hessen, Deutschland RP International Vollzeit

    Senior Data EngineerThe Senior Data Engineer will be responsible for designing, deploying, and maintaining the data pipeline architecture that is essential to our clients analytics and trading platforms. The ideal candidate will bridge the gap between data science and data management, ensuring data is accurate, accessible, and efficiently processed for...

  • Senior Data Engineer

    vor 2 Wochen

    Frankfurt am Main, Hessen, Deutschland Circunomics Vollzeit

    About the RoleWe are seeking a highly skilled Senior Data Engineer to join our team at Circunomics. As a Senior Data Engineer, you will be responsible for designing, developing, and deploying scalable, maintainable, efficient, and reliable applications using Python 3, FastAPI or Flask, with optional use of Angular.Key ResponsibilitiesEnd-to-End Development:...