Lead Data Solutions Engineer

vor 3 Wochen


Frankfurt am Main, Hessen, Deutschland vent Vollzeit

The objective of vent is to enhance the development of the German Mittelstand.

vent specializes in creating digital business strategies, innovative products, and services, while collaborating with and investing in emerging companies. We are a subsidiary of Deutsche Leasing AG and part of the Sparkassen-Finanzgruppe.

We are seeking a Lead Data Solutions Engineer (f/m/d) to join our Product Engineering division.

YOUR RESPONSIBILITIES

As a Lead Data Solutions Engineer (f/m/d), you will be an integral part of the Data Engineering Stream at vent, driving the implementation of data science models into production. Additionally, you will serve as the technical architect for all data science initiatives and lead the development of our analytics platform.

  • Collaborate with senior team members to design the software architecture for various A.I. products.
  • Ensure adherence to architectural principles established at the executive and strategic levels in both architecture and code.
  • Actively develop features for data science models and A.I. products while mentoring other data engineers on best practices.
  • Conduct peer reviews to identify inefficiencies and anti-patterns, ensuring high code quality.
  • Take ownership of the complete development lifecycle of a digital data product, from design through to deployment.
  • Contribute to shaping the software development frameworks, processes, and tools within the organization.
  • Define and enforce the testing strategy (unit, end-to-end, and stress tests) for data engineering activities.
  • Monitor compliance with established quality standards and ensure that delivered code meets these standards by continuously tracking SLIs defined by the SRE team.
  • Assist the CTO in workshops, design sessions, and stakeholder meetings.
  • Engage in meetups and external conferences to share the team's successes.

YOUR QUALIFICATIONS

  • Master's degree in computer science, engineering, informatics, or a related quantitative field.
  • A minimum of 5 years of experience as a Software Engineer with a strong emphasis on data-related projects or as a Data Engineer in a dynamic professional environment.
  • Proficiency in Python and familiarity with the PySpark API.
  • Solid understanding of various data storage formats (e.g., Parquet, Avro, ORC, JSON, CSV) and their respective advantages and disadvantages.
  • Experience with frameworks such as Django and Flask.
  • Ability to think in a distributed manner and apply the principles of the Map-Reduce design pattern in coding.
  • Understanding of the trade-offs associated with distributed architectures and the ability to think in parallel during coding tasks.
  • Capability to intuitively select the appropriate architecture and framework based on business requirements.
  • Experience in consuming or designing modern APIs, recognizing that an API encompasses more than just a technical concept.
  • Strong theoretical and practical knowledge of computer science fundamentals, including algorithms, time complexity, data structures, distributed systems, design patterns, API maturity levels, databases, eventual consistency, state management, and DevOps processes.
  • Proficient in using Git for version control and understanding the benefits of a DevOps approach, even in Data Science activities (ML-Ops).
  • Experience in operating systems and implementing non-functional requirements during the early stages of product development.
  • Familiarity with cloud-native development, preferably with Azure.

YOUR ATTRIBUTES

  • Strong analytical skills with the ability to decompose complex problems into manageable components.
  • A collaborative spirit, enjoying teamwork with highly skilled engineers and scientists.
  • Fluency in both English and German.

WHAT WE PROVIDE

  • Flexible working arrangements, including options for remote work.
  • Complimentary beverages and snacks in the office.
  • Modern hardware available for both professional and personal use.
  • Fitness budget managed through the emplu app.
  • Company pension scheme to secure your future.
  • Participation in internal events to foster team spirit and collaboration.
  • Opportunities for responsibility, quality assurance, co-design, and teamwork.
  • A start-up atmosphere supported by the stability of the Sparkassen Finanzgruppe.


  • Frankfurt am Main, Hessen, Deutschland InnoApps Vollzeit

    Die InnoApps Agentur GmbH sucht einen versierten Lead Data Solutions Engineer (m/w/d), der unser Team in der dynamischen Welt der Datenverarbeitung bereichert. Als innovatives Unternehmen in der Technologiebranche bieten wir maßgeschneiderte Beratung und Lösungen für Unternehmen, die auf Effizienz und Nachhaltigkeit setzen. Wir sind bestrebt, durch den...


  • Frankfurt am Main, Hessen, Deutschland KION Group Vollzeit

    Join KION Group as a Lead Data Solutions Engineer KION is enhancing its global Big Data Analytics Platform, which caters to a diverse range of applications, from exploratory Data Analytics to Machine Learning initiatives and Power BI dashboards. This role serves as the IT liaison for these projects. What We Provide: A forward-looking organization: As a...

  • Cloud Data Engineer

    Vor 2 Tagen


    Frankfurt am Main, Hessen, Deutschland Materna Information & Communications SE Vollzeit

    About the RoleWe are seeking a highly skilled Senior Data Engineer to join our team at Materna Information & Communications SE. As a Senior Data Engineer, you will be responsible for leading high-performance data-processing projects with a focus on Cloud solutions for our clients in the economy and administration sectors.Key ResponsibilitiesLead...


  • Frankfurt am Main, Hessen, Deutschland Amazon Development Center Germany GmbH Vollzeit

    About the RoleAs a Colocation Regional Engineer, you will be pivotal in driving Mechanical and Electrical Engineering services for the construction and implementation of enterprise data centers that adhere to high-quality and performance standards globally.Key ResponsibilitiesCollaborate with colocation vendors to assess and refine designs for new data...


  • Frankfurt am Main, Hessen, Deutschland Global Market Solutions GmbH Vollzeit

    About Global Market Solutions GmbHWe are a consultancy firm specializing in operational excellence through data and digital systems. Our expertise spans digital transformation, data analytics, and compliance, making us a vital partner in our clients' journeys towards digital advancement.Key ResponsibilitiesRequirements Analysis: Engage with business and data...


  • Frankfurt am Main, Hessen, Deutschland Blocksize Capital GmbH Vollzeit

    About the RoleWe are seeking a highly skilled Lead Software Engineer to join our market data team at Blocksize Capital GmbH. As a key member of our team, you will be responsible for designing and implementing innovative solutions for processing real-time and historical crypto market data.Key ResponsibilitiesDevelop and Maintain Market Data Infrastructure:...


  • Frankfurt am Main, Hessen, Deutschland zeroG GmbH Vollzeit

    What responsibilities will you undertake? At zeroG GmbH, you will play a pivotal role in assisting clients within the airline and aviation sectors to leverage data for transformative business outcomes, whether through collaborative consulting efforts or by crafting innovative solutions. In this position, your tasks will include: Developing...


  • Frankfurt am Main, Hessen, Deutschland Arup Vollzeit

    Shape a Better Future with Innovative Data Center SolutionsAt Arup, we believe in harnessing the power of design and engineering to create a more sustainable future. Our data center projects are at the forefront of this mission, ensuring that these critical infrastructure hubs operate efficiently, reliably, and with minimal environmental impact.Your Role:...


  • Frankfurt am Main, Hessen, Deutschland Deutsche Bank Vollzeit

    Job Overview:Diversity Commitment:We are dedicated to building skilled and diverse teams to achieve exceptional business outcomes. We encourage applications from individuals of all backgrounds, cultures, races, genders, sexual orientations, abilities, beliefs, and generations.Department/Team:As a member of one of our globally diverse, agile teams within the...

  • Data Engineer

    vor 1 Tag


    Frankfurt am Main, Hessen, Deutschland Materna Information & Communications SE Vollzeit

    About the RoleWe are seeking a highly skilled Data Engineer to join our team at Materna Information & Communications SE. As a Data Engineer, you will play a key role in designing and implementing high-performance data processing systems for the public sector, including administration, individual healthcare, mobility, energy and resource efficiency, and...

  • Data Engineer

    vor 1 Tag


    Frankfurt am Main, Hessen, Deutschland Materna Information & Communications SE Vollzeit

    About the RoleWe are seeking a highly skilled Data Engineer to join our team at Materna Information & Communications SE. As a Data Engineer, you will play a key role in designing and implementing high-performance data processing systems for the public sector, including administration, individual healthcare, mobility, energy and resource efficiency, and...

  • Senior Data Engineer

    Vor 4 Tagen


    Frankfurt am Main, Hessen, Deutschland zeroG GmbH Vollzeit

    About the RoleWe are seeking a highly skilled Senior Data Engineer to join our team at zeroG GmbH. As a Senior Data Engineer, you will play a key role in helping our airline and aviation-related customers transform their business with the power of data.Key ResponsibilitiesDesign and implement modern data infrastructure that enables our data scientists to...


  • Frankfurt am Main, Hessen, Deutschland Amazon Development Center Germany GmbH Vollzeit

    About the RoleAs a Colocation Regional Engineer, you will play a pivotal role in driving the Mechanical and Electrical Engineering services for the construction and implementation of enterprise data centers that adhere to quality and performance standards globally.Key ResponsibilitiesCollaborate with colocation vendors to assess and refine designs for new...


  • Frankfurt am Main, Hessen, Deutschland The chapter Technology & Engineering - Data & A Vollzeit

    Über das Team Das Kapitel Technologie & Ingenieurwesen - Daten & KI-Engineering vereint alle Fachleute, die Daten- und KI-Engineering-Fähigkeiten für unsere Produktteams bereitstellen. Diese Experten sind zusammen organisiert, um ihre funktionalen Fähigkeiten zu verbessern, die MLOps- und AIOps-Technologiestack von E.ON zu optimieren und ein hohes Maß...


  • Frankfurt am Main, Hessen, Deutschland Amazon Development Center Germany GmbH Vollzeit

    About the RoleWe are seeking a highly skilled Data Center Colocation Regional Engineer to join our team at Amazon Development Center Germany GmbH. As a key member of our team, you will be responsible for driving Mechanical/Electrical Engineering services, construction, and implementation of enterprise data centers that meet quality and performance levels...


  • Frankfurt am Main, Hessen, Deutschland msg systems Vollzeit

    (Senior) Cloud Data Engineer / Innovative Datenlösungen (m/w/d)Sie sind technikaffin, streben nach Effizienz und möchten, dass alle Systeme und Abläufe reibungslos funktionieren? Dann sind Sie bei uns genau richtig. Mit unseren digitalen Lösungen in den Bereichen MDM, BI, Analytics, Big Data und IoT unterstützen wir Unternehmen dabei, aus Daten...


  • Frankfurt am Main, Hessen, Deutschland activjob GmbH - Bautzen Vollzeit

    Data EngineerOverview:activjob GmbH - Bautzen is in search of a skilled Data Engineer to enhance our dynamic team. In this pivotal role, you will focus on the development and implementation of data solutions utilizing cloud platforms such as Azure and AWS. Your expertise will contribute to the creation of microservice architectures and the maintenance of...


  • Frankfurt am Main, Hessen, Deutschland zeroG GmbH Vollzeit

    Join our innovative team at zeroG GmbH, where we are seeking a skilled and passionate professional in the aviation sector.Position Overview:Engage with a group of data specialists to create customized solutions that enhance business performance in the aviation field.Assist in pre-sales initiatives by facilitating client workshops, offering technical...

  • Regional Director

    vor 6 Stunden


    Frankfurt am Main, Hessen, Deutschland CBRE Global Workplace Solutions Data Center Solutions Vollzeit

    About CBRE Data Center SolutionsCBRE Data Center Solutions is a leading provider of data center services, with a global presence and a team of experts dedicated to delivering exceptional results.We are a part of the CBRE Group, a Fortune 500 company with a rich history of innovation and excellence. Our data center solutions are designed to meet the evolving...


  • Frankfurt am Main, Hessen, Deutschland Blocksize Capital GmbH Vollzeit

    About Blocksize Capital GmbH Blocksize Capital GmbH is a dynamic startup company revolutionizing the financial market landscape by empowering participants with cutting-edge solutions for market data, issuance, trading, staking, and managing digital assets. Our mission is to provide reliable and accurate crypto price feeds to financial institutions worldwide,...