Data Engineer
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Tech stack
+20 more
Job description
Job DescriptionProject DescriptionWe are looking for skilled Junior Data Engineer to join our team in DBIZ.The Technik Value Stream teams are responsible for Data Ingest on ODE, development of the relevant data products on ODE, Operations of the data products on ODEActivity description and concrete tasksInfrastructure Deployment & Management: Efficiently deploy and manage infrastructure on Google Cloud Platform (GCP) including network architectures (Shared VPC, Hub-and-Spoke), security implementations (IAM, Secret Manager, firewalls, Identity-Aware Proxy), DNS configuration, VPN, and Load Balancing.Data Processing & Transformation: Utilize Hadoop cluster with Hive for querying data, and PySpark for data transformations.Implement job orchestration using Airflow.Core GCP Services Management: Work extensively with services like Google Kubernetes Engine (GKE), Cloud Run, BigQuery, Compute Engine, and Composer, all managed through Terraform.Application Implementation: Develop and implement Python applications for various GCP services.CI/CD Pipelines: Integrate and manage GitLab Magenta CI/CD pipelines for automating cloud deployment, testing, and configuration of diverse data pipelines.Security & Compliance: Implement comprehensive security measures, manage IAM policies, secrets using Secret Manager, and enforce identity-aware policies.Data Integration: Handle integration of data sources from CDI, Datendrehscheibe (FTP servers), TARDIS API ?s and Google Cloud Storage (GCS).Multi-environment Deployment: Create and deploy workloads across Development (DEV), Testing (TEST), and Production (PROD) environments.AI Solutions : Implement AI solutions using Google’s Vertex AI for building and deploying machine learning models.Certification Desired: Must be a certified GCP Cloud Architect or Data Engineer.QualificationsSkills RequiredFamiliarity withGCP.Familiarity with Terraform for infrastructure management.Python for application implementation.Familiarity with GitLab CI/CD for automation.Familiarity withnetwork architectures, security implementations, and management of core GCP services.Knowledge in employing data processing tools like Hive, PySpark , and data orchestration tools like Airflow .Familiarity with managing and integrating diverse data sources.Certified GCP Cloud Architect and Data Engineer would be beneficial .Additional InformationWhatdoweofferyou?Workenvironment&flexibilityInternational,dynamicandcollaborativeenvironment.T-Social: socialinitiatives(sports,community,health, …).Hybridworkmodel(remote/on-site).Flexibleworkinghours.Growth&developmentCustomizedtraining:accesstoCourseratolearnwhateveryouwant,wheneveryouwant.Weeklylanguageclasses(English & German).InternationalMentoringSessions&ExperienceDays.Compensation&benefitsFlexiblecompensationplan (healthinsurance,mealvouchers,childcare,transport).Telemedicine.Lifeandaccidentinsurance.Socialfund.Wellbeing& time off26+workingdaysofvacationperyear.Freeaccesstospecialistservices(medical, legal,wellness).100%salarycoverageduringmedicalleave.And many more advantages of being part of T-Systems!If you are looking for a new challenge, do not hesitate to send us your CV!Please send CV in English.Join our team!T-Systems Iberia will only process the CVs of candidates who meet the requirements specified for each offer.Your TaskWe are looking for a skilled Junior Data Engineer to join our team in DBIZ.The Technik Value Stream teams are responsible for Data Ingest on ODE, development of the relevant data products on ODE, and Operations of the data products on ODE.ResponsibilitiesInfrastructure Deployment & Management: Efficiently deploy and manage infrastructure on Google Cloud Platform (GCP) including network architectures (Shared VPC, Hub-and-Spoke), security implementations (IAM, Secret Manager, firewalls, Identity-Aware Proxy), DNS configuration, VPN, and Load Balancing.Data Processing & Transformation: Utilize Hadoop cluster with Hive for querying data, and PySpark for data transformations.Implement job orchestration using Airflow.Core GCP Services Management: Work extensively with services like Google Kubernetes Engine (GKE), Cloud Run, BigQuery, Compute Engine, and Composer, all managed through Terraform.Application Implementation: Develop and implement Python applications for various GCP services.CI/CD Pipelines: Integrate and manage GitLab Magenta CI/CD pipelines for automating cloud deployment, testing, and configuration of diverse data pipelines.Security & Compliance: Implement comprehensive security measures, manage IAM policies, secrets using Secret Manager, and enforce identity-aware policies.Data Integration: Handle integration of data sources from CDI, Datendrehscheibe (FTP servers), TARDIS API’s and Google Cloud Storage (GCS).Multi-environment Deployment: Create and deploy workloads across Development (DEV), Testing (TEST), and Production (PROD) environments.AI Solutions: Implement AI solutions using Google’s Vertex AI for building and deploying machine learning models.Your ProfileWe are seeking a skilled Junior Data Engineer with strong technical expertise in Google Cloud Platform, infrastructure management, data processing tools, and CI/CD automation to join our DBIZ team.Must Have SkillsFamiliarity with Google Cloud Platform (GCP)Familiarity with Terraform for infrastructure managementPython programming for application implementationFamiliarity with GitLab CI/CD for automationFamiliarity with network architecturesFamiliarity with security implementationsFamiliarity with management of core GCP servicesKnowledge in employing data processing tools like Hive and PySparkKnowledge in data orchestration tools like AirflowFamiliarity with managing and integrating diverse data sourcesNice to Have SkillsCertified GCP Cloud ArchitectCertified GCP Data Engineer
Requirements
Familiarity withGCP. Familiarity with Terraform for infrastructure management. Python for application implementation. Familiarity with GitLab CI/CD for automation. Familiarity withnetwork architectures, security implementations, and management of core GCP services. Knowledge in employing data processing tools like Hive, PySpark , and data orchestration tools like Airflow . Familiarity with managing and integrating diverse data sources. Certified GCP Cloud Architect and Data Engineer would be beneficial .
Benefits & conditions
Workenvironment&flexibility International,dynamicandcollaborativeenvironment. T-Social: socialinitiatives(sports,community,health, …). Hybridworkmodel(remote/on-site). Flexibleworkinghours. Growth&development Customizedtraining:accesstoCourseratolearnwhateveryouwant,wheneveryouwant. Weeklylanguageclasses(English & German). InternationalMentoringSessions&ExperienceDays. Compensation&benefits Flexiblecompensationplan (healthinsurance,mealvouchers,childcare,transport). Telemedicine. Lifeandaccidentinsurance. Socialfund. Wellbeing& time off 26+workingdaysofvacationperyear. Freeaccesstospecialistservices(medical, legal,wellness).
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Good distractions
Loading talks and stories from around this role…