> Markdown version of [/jobs/ext/1380890-senior-data-engineer](https://www.wearedevelopers.com/jobs/ext/1380890-senior-data-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Senior Data Engineer - **Company:** Fehrmann Tech Group - **Location:** Hamburg, Germany (Remote available) - **Experience:** Expert - **Contract:** Permanent contract - **Skills:** Artificial Intelligence, Amazon Web Services, Data Analysis, Audit Trail, Microsoft Azure, Big Data, Cloud Database, Cloud Engineering, Continuous Integration, Data as a Services, Information Engineering, Data Governance, Data Sharing, Dataspaces, Database Queries, Linux, DevOps, Distributed Computing Environment, Python (Programming Language), Laboratory Information Management Systems, Metadata, Metadata Standards, DataOps, Software Deployment, Systems Integration, Unstructured Data, Management of Software Versions, Workflow Management Systems, Enterprise Application Integration, Data Logging, Enterprise Software Applications, Cloud Platform System, Large Language Models, Git, Kubernetes, Information Technology, Integration Frameworks, Data Management, Machine Learning Operations, Data Pipelines - **Published:** July 22, 2026 - **Apply:** https://www.adzuna.de/details/5727287936 ## About the Role * Degree in Computer Science, Data Science & Engineering, Mathematics, Natural Sciences, or a comparable field * 5+ years of professional experience in data engineering, cloud engineering, or MLOps * Hands-on experience deploying ML and/or LLM-based applications in enterprise-grade cloud environments * Proven experience working with large-scale scientific datasets, ideally in simulation-heavy or R&D environments (materials, chemistry, physics, CAE, computational engineering) * Experience designing or operating data ecosystems that unify multiple data domains (simulation + experiments) with strong governance and provenance Technical skills * Strong Python skills and experience with data processing frameworks * Strong SQL skills and experience with data modeling for analytics and production use cases * Proven experience with Microsoft Azure (Data Services, Compute, Storage, Azure OpenAI); AWS/GCP experience is also valued * Solid understanding of DevOps/DataOps/MLOps practices, CI/CD pipelines, and automation * Strong experience with containers (Kubernetes), Linux, Git, and system integration * Familiarity with cloud databases, security concepts, and enterprise integration patterns * Experience with orchestration tools and operational reliability practices * Exposure to LLM workflows and RAG architectures; agentic AI experience is a strong plus * Practical knowledge of distributed data processing and scaling patterns for ingestion/transform/query of very large datasets * Bonus: familiarity with computational materials science/materials informatics, simulation pipelines, or lab data management (LIMS/ELN/instrumentation exports) Working style * Structured, pragmatic, and hands-on with strong ownership * Able to communicate clearly across technical and non-technical stakeholders * Curious about new technologies and able to translate them into reliable production systems * Excellent communication skills in English; German is a plus ## Description * Design, implement, and operate scalable data pipelines for structured and unstructured data (batch and, where needed, streaming) * Develop cloud-native architectures for data and AI workloads (primarily on Microsoft Azure) * Build and evolve a materials data ecosystem linking physics-based modeling/simulation data and experimental laboratory data * Handle large-scale scientific datasets (e.g., atomistic simulations, DFT/MD, high-throughput campaigns), including efficient storage, metadata, and performant access patterns * Integrate data from HPC/simulation workflows and laboratory systems (instrument exports, LIMS/ELN where applicable) into curated, analysis-ready datasets * Define and implement data models, metadata standards, and provenance to ensure traceability, reproducibility, and auditability across simulations and experiments * Establish robust data quality practices (validation rules, unit consistency, schema controls) and data quality monitoring aligned with operational SLAs/SLOs * Implement data governance foundations (cataloging, access control, lineage) and enable policy-driven data sharing across teams * Enable production deployment of ML and NLP/LLMs/VLMs/VLAs etc. applications through strong MLOps/DataOps practices * Integrate Azure OpenAI and LLM-based services into enterprise applications in a secure and maintainable way * Implement Infrastructure-as-Code, CI/CD pipelines, and automation for data and AI systems * Ensure reliability, security, GDPR compliance, monitoring/observability (logging, metrics, alerting), and cost efficiency of cloud platforms * For LLM/RAG systems: manage embeddings and vector retrieval lifecycle, introduce evaluation and monitoring, and apply prompt/config versioning for repeatable releases * Provide technical leadership through design reviews, documentation of standards, and mentoring where appropriate ## Related Videos - [How a Small Team Shrank a Microsoft Monorepo by 94%](https://www.wearedevelopers.com/videos/1236-how-a-small-team-shrank-a-microsoft-monorepo-by-94) - [Docker network without Docker](https://www.wearedevelopers.com/videos/1418-docker-network-without-docker) - [From DevOps to Scaled DevOps: How We’re Rebuilding Continuous Delivery as a Platform](https://www.wearedevelopers.com/videos/100018-from-devops-to-scaled-devops-how-we-re-rebuilding-continuous-delivery-as-a-platform) - [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works) - [#90DaysOfDevOps - The DevOps Learning Journey](https://www.wearedevelopers.com/videos/548-90daysofdevops-the-devops-learning-journey) - [Git for Code Reviews](https://www.wearedevelopers.com/videos/429-git-for-code-reviews) ## Related Articles - [Data Analyst Salary Germany](https://www.wearedevelopers.com/magazine/277-data-analyst-salary-germany) - [The Biggest German Tech Companies](https://www.wearedevelopers.com/magazine/424-the-biggest-german-tech-companies) - [The Most Popular IT Jobs on the Market](https://www.wearedevelopers.com/magazine/376-the-most-popular-it-jobs-on-the-market) - [Backend Developer Salary in Germany [2023]](https://www.wearedevelopers.com/magazine/196-backend-developer-salary-in-germany-2023) - [Frontend Developer Salary in Germany [2023]](https://www.wearedevelopers.com/magazine/195-frontend-developer-salary-in-germany-2023) - [Software Developer Salary in Germany [2023]](https://www.wearedevelopers.com/magazine/194-software-developer-salary-in-germany-2023)