Big Data
Vor 3 Tagen
Deutschland
Projectstudy
Vollzeit
70.000 € - 110.000 € Vertrag
Kostenlos per E-Mail oder Google
Speichern Sie diesen Job und halten Sie Ihre Suche organisiert
Erstellen Sie ein kostenloses Konto, um Jobs zu speichern, Benachrichtigungen zu erstellen und von Ihrem Dashboard aus zu diesem Eintrag zurückzukehren.
Kostenlos per E-Mail oder Google
Wenn Sie fortfahren, akzeptieren Sie unsere Nutzungsbedingungen & Datenschutzerklärung.
Stand out## Stand out with a real ProoV project on your CV.
Recruiters skim hundreds of CVs. A ProoV certificate is evidence they can verify in one click
- attach it to this application and you stop being a *claim
* and start being *proof*.
* time-series
* forecasting
* retail-analyticsA certificate a recruiter verifies
* machine-learning
* regression
* random-forestA certificate a recruiter verifies
* Python
* Reward design
* Policy searchA certificate a recruiter verifies
· Est. 3-4 hoursMatched to this exact role by skill
- not a generic list.
Closest match to this role. You finish with a certificate a recruiter can check in one click and a real piece of work to talk through in the interview
- about 3-4 hours.## About this roleBig Data & Backend Engineer
- Spatial ETL (m/f/d)
Location:
Germany (Hybrid / Remote options available)Contract Type: Full-Time Employment (Permanent)Target Group: Backend Engineers, Data Engineers, Database Administrators, Opportunity Card Holders, and Master's GraduatesAbout Project IRIS Project IRIS is a proprietary applied research initiative processing massive amounts of infrastructure and spatial data. We bridge the gap between fragmented public data and actionable infrastructure intelligence.
When standard APIs reach their limits and entire national registries must be processed, you step in. In this role, you are the architect for heavy data loads and robust backend pipelines.
Your Focus & Responsibilities
* Bulk Processing: Automate the download and processing of massive data dumps (e.g., corporate registers, industrial emission databases like PRTR, energy grids).
* ETL Engineering: Program high-performance ETL pipelines that decompress, parse, and transfer complex archives into our central PostgreSQL architecture.
* Database Governance: Ensure idempotency, deduplication, and reliable monitoring during weekly multi-million row updates.
* Container Orchestration: Deploy and maintain isolated Docker environments for all ingestion tasks.
What We Are Looking For
* Technical Background: Degree in Computer Science, Software Engineering, or extensive practical backend industry experience.
* Core Technical
Skills:
Expertise in processing relational mass data, strong Python skills (SQLAlchemy, Pandas), and deep PostgreSQL performance tuning.
* Mindset: A clean-code engineering approach focused on system stability and scalability.
* Eligibility: Open to local applicants and international candidates (Chancenkarte / Opportunity Card supported).
* Languages: Professional working proficiency in English (required); German language skills are a plus.###
What We Offer
* Full-Time Permanent Employment: Long-term career stability with clear growth trajectories.
* Dual Master / Trainee Track Available: Tailored tracks including academic coordination and complete tuition support.
* Accommodation & Onboarding Package: Structured assistance with local accommodation, official registration, and comprehensive onboarding.
* Visa & Administrative Backing: Dedicated employer support for Opportunity Card conversions and visa applications.
* Modern Tech Environment: Work in a high-efficiency environment centered on Python, PostGIS, and Docker.###
How to Apply
Send your CV by E-Mailjobs-trainee@iris-institut.org (Subject: Application
- Big Data & Backend Engineer)
Recruiters skim hundreds of CVs. A ProoV certificate is evidence they can verify in one click
- attach it to this application and you stop being a *claim
* and start being *proof*.
* time-series
* forecasting
* retail-analyticsA certificate a recruiter verifies
* machine-learning
* regression
* random-forestA certificate a recruiter verifies
* Python
* Reward design
* Policy searchA certificate a recruiter verifies
· Est. 3-4 hoursMatched to this exact role by skill
- not a generic list.
Closest match to this role. You finish with a certificate a recruiter can check in one click and a real piece of work to talk through in the interview
- about 3-4 hours.## About this roleBig Data & Backend Engineer
- Spatial ETL (m/f/d)
Location:
Germany (Hybrid / Remote options available)Contract Type: Full-Time Employment (Permanent)Target Group: Backend Engineers, Data Engineers, Database Administrators, Opportunity Card Holders, and Master's GraduatesAbout Project IRIS Project IRIS is a proprietary applied research initiative processing massive amounts of infrastructure and spatial data. We bridge the gap between fragmented public data and actionable infrastructure intelligence.
When standard APIs reach their limits and entire national registries must be processed, you step in. In this role, you are the architect for heavy data loads and robust backend pipelines.
Your Focus & Responsibilities
* Bulk Processing: Automate the download and processing of massive data dumps (e.g., corporate registers, industrial emission databases like PRTR, energy grids).
* ETL Engineering: Program high-performance ETL pipelines that decompress, parse, and transfer complex archives into our central PostgreSQL architecture.
* Database Governance: Ensure idempotency, deduplication, and reliable monitoring during weekly multi-million row updates.
* Container Orchestration: Deploy and maintain isolated Docker environments for all ingestion tasks.
What We Are Looking For
* Technical Background: Degree in Computer Science, Software Engineering, or extensive practical backend industry experience.
* Core Technical
Skills:
Expertise in processing relational mass data, strong Python skills (SQLAlchemy, Pandas), and deep PostgreSQL performance tuning.
* Mindset: A clean-code engineering approach focused on system stability and scalability.
* Eligibility: Open to local applicants and international candidates (Chancenkarte / Opportunity Card supported).
* Languages: Professional working proficiency in English (required); German language skills are a plus.###
What We Offer
* Full-Time Permanent Employment: Long-term career stability with clear growth trajectories.
* Dual Master / Trainee Track Available: Tailored tracks including academic coordination and complete tuition support.
* Accommodation & Onboarding Package: Structured assistance with local accommodation, official registration, and comprehensive onboarding.
* Visa & Administrative Backing: Dedicated employer support for Opportunity Card conversions and visa applications.
* Modern Tech Environment: Work in a high-efficiency environment centered on Python, PostGIS, and Docker.###
How to Apply
Send your CV by E-Mailjobs-trainee@iris-institut.org (Subject: Application
- Big Data & Backend Engineer)