Senior Data Engineer
vor 3 Wochen
As a global leader in combining people and technology to help companies realise the disruptive potential of AI, CloudFactory is seeking highly skilled and experienced Senior Data Engineers to join our dynamic team to help mature our data platform.
You will have the opportunity to work with cutting-edge technologies and collaborate with a diverse and talented team to scale our data processing capabilities, whilst creating economic opportunities for talented individuals in developing nations.
Whilst we offer remote work flexibility, we expect this role to be office-based two days a week.
ResponsibilitiesThe successful candidate will translate user requirements into actionable insights by leveraging existing tools and technologies. Your responsibilities will include:
- Regular interaction with PMs/stakeholders to understand their requirements
- Investigation to ascertain if the requirements can be met using existing technology and data resources
- Data extraction using Python and other tools like Fivetran
- Data modelling using SQL and the concept of Star and Snowflake schema
- Assisting in cost and performance optimization choices within the data warehouse. Communicating reasoning and logic behind opinions to help make optimal choices
- Write data quality and other metadata collection systems within data pipelines to promote observability and recoverability of pipelines
- Write unit and integration tests to bolster system reliability
- Proactively identify the areas of improvement, propose solutions and manage technical debt
- Mentoring, guiding and line management of three/four team members.
Our tech stack:
- Data extraction and orchestration tools - Fivetran, Prefect
- Data modelling tool - DBT
- Data Warehouse - Snowflake
- Data quality cheeks - dbt, Elementary
- Data visualisation - Tableau and Quicksight
- Data catalogue and lineage - Atlan, dbt
- Source code management - Github
- Infrastructure as Code - Terraform, Cloudformation
- Programming Language - Python
- AWS services (ECS, S3)
Interview Process
Candidates will be expected to complete an initial coding and analytical thinking test, followed by an interview with Data Architect and Senior Product Manager where they will be expected to talk through previous projects, including approaches taken and results achieved.
Successful candidates will then meet with the Engineering Director before a final interview with the CTO.
The process is expected to take 1-2 weeks.
Requirements
The ideal candidate will possess:
- Proficiency in requirement capture and technical design
- Mastery in Data pipeline development
- Proficiency with extracting data from source systems using Python
- Mastery in transforming data using SQL and data transformation tools
- Mastery of data modelling concepts and practices, preferably with Star schema
- Proficiency in writing data quality tests
- Proficiency in writing end-to-end tests using test scenarios approach including test data creation and management
- Proficiency in data pipeline observability techniques (e.g. monitoring, alerting, anomaly detection etc)
- Some experience in building reports and dashboards
- Data Warehouse administration
- Proficiency with Data Warehouse administration (e.g. roles, permissions, compute, performance)
- Data security and Governance
- Proficiency in Data security and Governance (e.g. RBAC, encryption, masking, data classification and tagging, time travel and data recovery) practices
- Some knowledge of using data catalogue and data lineage tools preferably Atlan and dbt documentation
- Performance and cost optimization
- Proficiency in performance and cost optimization of database queries using tools and techniques
- Proficiency with line management to manage a team of Data Engineers and Data Analysts/Analytics Engineers
- Excellent communication skills, able to translate complex data into understandable insights and narratives.
Benefits
Location dependent, but can include
- Office snacks provided Monday-Friday, lunches
- Home work and allowance
- Medical
- Amazing Company Mission and Culture
- Growth Opportunities
Join us, and change the world for the better. If you are skilled and humble, with a commitment to lifelong learning, and you’re curious about the world and its people, you could be a good fit at CloudFactory. We welcome the unique contributions you can bring to help us build a diverse, inclusive workplace because we connect, learn, and grow stronger from our differences. We want you to bring your whole, authentic self to work.
We look forward to hearing from you
Still unsure? Read ‘5 Reasons You Should Work at CloudFactory’.
-
Senior Data Engineer
vor 3 Wochen
Berlin, Deutschland Digital Waffle VollzeitDigital Waffle is proud to have partnered with an innovative tech company in Berlin who are on a mission to revolutionise the energy sector with data-driven insights maximising the efficiency and impact of renewable energy solutions About the Role:I am seeking a passionate Senior Data Engineer to play a pivotal role in our client's mission to combat climate...
-
Senior Data Engineer
vor 2 Wochen
Berlin, Deutschland Materna VollzeitAdvanced Smart Services sind die Zukunft der digitalen Gesellschaft. Moderne Datenökonomien gelten als die wichtigste Basis, um großen Herausforderungen wie Gesundheitsvorsorge, Nachhaltigkeit im Sinne von Energie- und Ressourceneffizienz, Klimawandel sowie Umweltschutz gewachsen zu sein. Daher arbeiten unsere interdisziplinären Teams tagtäglich...
-
Senior Data Engineer
vor 4 Wochen
Berlin, Deutschland Novatec Consulting GmbH VollzeitSenior Data Engineer (m/w/d) bei Novatec Consulting GmbH | softgarden View job here Senior Data Engineer (m/w/d) Voll- oder Teilzeit Berlin, Deutschland Hybrid Mit Berufserfahrung ...
-
Senior Data Engineer
Vor 4 Tagen
Berlin, Deutschland Novatec Consulting GmbH VollzeitSenior Data Engineer (m/w/d) bei Novatec Consulting GmbH | softgarden View job here Senior Data Engineer (m/w/d) Voll- oder Teilzeit Berlin, Deutschland Hybrid Mit Berufserfahrung ...
-
Senior Data Engineer
vor 4 Wochen
Berlin, Deutschland KARL STORZ SE & Co. KG VollzeitBei KARL STORZ sind wir stolz darauf, Patientinnen und Patienten auf den schwierigsten Wegen ihres Lebens zu unterstützen. Dabei leisten wir Beiträge, die wirklich zählen. Unabhängig von Ihrer Rolle tragen SIE jeden Tag dazu bei, das Leben von Menschen zu verbessern. Lernen Sie uns kennen und werden Sie Teil des Teams als Senior Data Engineer (m/w/d) ...
-
Senior Software Engineer
vor 3 Wochen
Berlin, Deutschland Snowflake VollzeitBuild the future of data. Join the Snowflake team. We’re hiring talented Senior Software Engineers to expand the Snowflake data streaming team here in Berlin, Germany and help us build the next generation of real time streaming data platform and enable our customers to bring insights to their data with extremely low latency and extremely high throughput....
-
Senior Data Engineer
vor 3 Wochen
Berlin, Berlin, Deutschland Adevinta VollzeitFor our team in Berlin we are looking for a Senior Data Engineer (d/f/m) for our Communications team.Our mission is to enable our customers to do the mobility changes that they need (buying and selling of vehicles, including concerns on the way like financing and insuring a car) completely online, and to enable the more than car dealers in Germany who are...
-
Senior Data Center Engineer
vor 4 Wochen
Berlin, Deutschland Bundesdruckerei-Gruppe VollzeitSenior Data Center Engineer (m/w/d) Unternehmen: Bundesdruckerei GmbH Standort: Berlin Vertragsart: Unbefristeter Vertrag Gestalten Sie mit uns die digitale Zukunft! Wir suchen Persönlichkeiten mit Teamgeist, die unsere Leidenschaft für den Schutz von Identitäten und Daten teilen, vorausschauend denken und gemeinsam mit uns an sicheren...
-
Senior Software Engineer
vor 1 Monat
Berlin, Deutschland Snowflake VollzeitBuild the future of data. Join the Snowflake team. Weâre hiring talented Senior Software Engineers to expand the Snowflake data streaming team here in Berlin, Germany and help us build the next generation of real time streaming data platform and enable our customers to bring insights to their data with extremely low latency and extremely high...
-
Senior Data Center Engineer
vor 4 Wochen
Berlin, Deutschland Bundesdruckerei-Gruppe VollzeitGestalten Sie mit uns die digitale Zukunft! Wir suchen Persönlichkeiten mit Teamgeist, die unsere Leidenschaft für den Schutz von Identitäten und Daten teilen, vorausschauend denken und gemeinsam mit uns an sicheren Digitalisierungslösungen arbeiten wollen. Wir sind überzeugt, dass Veränderungen neue Chancen für Entwicklung und Innovation mit sich...
-
Senior Data Center Engineer
vor 4 Wochen
Berlin, Deutschland Bundesdruckerei-Gruppe VollzeitGestalten Sie mit uns die digitale Zukunft! Wir suchen Persönlichkeiten mit Teamgeist, die unsere Leidenschaft für den Schutz von Identitäten und Daten teilen, vorausschauend denken und gemeinsam mit uns an sicheren Digitalisierungslösungen arbeiten wollen. Wir sind überzeugt, dass Veränderungen neue Chancen für Entwicklung und Innovation mit sich...
-
Senior Data Engineer
vor 4 Wochen
Berlin, Deutschland Almedia VollzeitAlmedia is the next generation, gamified promotion platform committed to delivering maximum value to both advertisers and consumers. With the goal of boosting our customers' user acquisition, revenue, and branding, we attract and motivate high-quality users to consume offers, surveys, or ads through our innovative products. Located in the heart of Berlin, we...
-
Senior Data Engineer
Vor 7 Tagen
Berlin, Deutschland Almedia VollzeitAlmedia is the next generation, gamified promotion platform committed to delivering maximum value to both advertisers and consumers. With the goal of boosting our customers' user acquisition, revenue, and branding, we attract and motivate high-quality users to consume offers, surveys, or ads through our innovative products. Located in the heart of Berlin, we...
-
(Senior) Data Engineer
vor 4 Wochen
Berlin, Deutschland GLSNXT VollzeitAbout this positionWe’re looking for a highly motivated and experienced Data Engineer to contribute to the scaling of our data infrastructure to meet the evolving needs of our growing business. As a Data Engineer, you will play a key role in delivering and enhancing GLSNXT data pipelines and warehouses while focusing on Looker development. This position...
-
Senior Data Engineer
vor 2 Wochen
Berlin, Deutschland Project A Ventures VollzeitAbout the Job We're looking for an experienced Senior Data Engineer (m/f/d) to join our portfolio company and support the team in their data strategies. In your day-to-day work, you will work alongside a group of highly ambitious and knowledgeable Engineers, while being faced with complex problems. Join our portfolio company: Founded in 2021 with...
-
Senior Software Engineer
vor 3 Wochen
Berlin, Deutschland Snowflake VollzeitBuild the future of data. Join the Snowflake team. We’re hiring talented Senior Software Engineers with experience in building Databases to expand the Snowflake SQL Data Types team here in Berlin, Germany. Join us to provide customers with a clear and intuitive interface to storing and processing data of all kinds with rich feature coverage and the...
-
Senior Software Engineer
vor 1 Monat
Berlin, Deutschland Snowflake VollzeitBuild the future of data. Join the Snowflake team.Weâre hiring talented Senior Software Engineers with experience in building Databases to expand the Snowflake SQL Data Types team here in Berlin, Germany. Join us to provide customers with a clear and intuitive interface to storing and processing data of all kinds with rich feature coverage and the best...
-
Senior Software Engineer
vor 3 Wochen
Berlin, Deutschland Snowflake VollzeitBuild the future of data. Join the Snowflake team. We’re hiring an exceptional Senior Software Engineer to work on Snowpark, Snowflake's Extensibility platform in Berlin. With an architecture that's already industry-leading in terms of scale, concurrency, and overall performance, we are seeking a talented senior software engineer to expand Snowflake’s...
-
Senior Software Engineer
vor 1 Monat
Berlin, Deutschland Snowflake VollzeitBuild the future of data. Join the Snowflake team.Weâre hiring an exceptional Senior Software Engineer to work on Snowpark, Snowflake's Extensibility platform in Berlin. With an architecture that's already industry-leading in terms of scale, concurrency, and overall performance, we are seeking a talented senior software engineer to expand...
-
Senior Data Analyst
vor 4 Wochen
Berlin, Deutschland Reload Search Ltd VollzeitReload is partnered with a global Retail giant who is on the lookout for a 'Senior Data Analyst' as they grow out their Data function. As a Senior Data Analyst, you will work closely with the analytics and digital product teams to help provide high level actionable insights and recommendations through the vast amount of real time data you will be provided....
