Senior Data Engineer
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Tech stack
+21 more
Job description
Bachelors or master’s degree in computer science, software engineering, or a related field5+ years of professional experience in data engineering, including ownership of production data platforms or pipelinesExpert programming skills in Python and strong command of SQLExpertise in data modeling, ETL development, and database management, with both SQL and NoSQL databasesHands-on experience with lakehouse architectures and columnar / open table formats (e.g., Parquet, Apache Iceberg, Delta Lake)Experience with distributed data processing frameworks such as Spark, and with workflow orchestrators such as Airflow or Argo WorkflowsStrong experience with cloud data platforms (Azure, AWS, or GCP), including object storage, containers, and KubernetesSolid grounding in data governance: catalogs, metadata, lineage, access control, and dataset versioningComfortable with Git-based workflows, CI/CD, and infrastructure-as-code working modelsExcellent problem-solving, communication, and collaboration skills; able to lead technical discussions with clients and stakeholders in EnglishResponsibilitiesOwn the end-to-end design and delivery of data platform architectures - lakehouse, data catalog, and governance - from initial scoping through production releaseDesign, implement, and operate large-scale ETL/ELT pipelines and workflow orchestration to ensure data is clean, accurate, versioned, and accessibleDefine data modeling, partitioning, schema evolution, and versioning conventions so datasets remain queryable, interoperable, and reproducible at scaleEstablish and maintain authoritative data catalogs, including schemas, metadata, lineage, sensitivity labels, and access policiesValidate released datasets against their sources for completeness, correctness, schema consistency, and query performance, defining objective acceptance criteriaWork closely with Machine Learning and AI Engineers to make data products directly consumable by analytics, APIs, and AI/agent workflowsCollaborate with clients and cross-functional teams to scope requirements, lead technical sessions, and document architectures for knowledge transfer and internal ownershipMentor and support other data engineers, reviewing designs and code and raising the team’s engineering standardsStay up to date with emerging trends in data engineering - open table formats, data catalogs, orchestration - and drive their adoption where they add value#J-*****-Ljbffr
Requirements
Bachelors or master’s degree in computer science, software engineering, or a related field 5+ years of professional experience in data engineering, including ownership of production data platforms or pipelines Expert programming skills in Python and strong command of SQL Expertise in data modeling, ETL development, and database management, with both SQL and NoSQL databases Hands-on experience with lakehouse architectures and columnar / open table formats (e.g., Parquet, Apache Iceberg, Delta Lake) Experience with distributed data processing frameworks such as Spark, and with workflow orchestrators such as Airflow or Argo Workflows Strong experience with cloud data platforms (Azure, AWS, or GCP), including object storage, containers, and Kubernetes Solid grounding in data governance: catalogs, metadata, lineage, access control, and dataset versioning Comfortable with Git-based workflows, CI/CD, and infrastructure-as-code working models Excellent problem-solving, communication, and collaboration skills; able to lead technical discussions with clients and stakeholders in English
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Apply on www.buscojobs.com.esGood distractions
Talks and stories from around this role — technically off-topic, practically not.
Moments
Explore playlistsVideos
See allRelated articles
See all
Making Data Warehouses Fast: A Developer’s Story
Highest Paying Tech Companies for Developers
Top Big Data Technologies That You Need to Know
Top-Paying Tech Jobs (with Salaries)