> Markdown version of [/jobs/ext/3077831-data-engineer](https://www.wearedevelopers.com/jobs/ext/3077831-data-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Data Engineer

- **Company:** VIIS GLOBAL LLC
- **Location:** Pasadena, CA, United States
- **Experience:** Expert
- **Contract:** Permanent contract
- **Skills:** Adobe InDesign, Application Programming Interfaces (APIs), Airflow, Amazon Web Services, Amazon S3, Big Data, Databases, Continuous Integration, Data Architecture, Data Validation, Information Engineering, Data Governance, Extract Transform Load (ETL), Data Transformation, Database Queries, Apache Hive, Identity and Access Management, Python (Programming Language), Web Application Frameworks, Data Processing, Data Storage Technologies, Apache Spark, AWS Lambda, Git, Data Lakes, Pyspark, AWS Glue, AWS Data Analytics, Apache Kafka, Cloudwatch, Terraform, Data Pipelines, Amazon Elastic Mapreduce (EMR), Amazon Redshift, Databricks
- **Published:** September 25, 2026
- **Apply:** https://www.dice.com/job-detail/0fba8584-ad6f-444d-912b-4d0e6b480fd5

## About the Role

* 10+ years of overall Data Engineering experience preferred.
 * Strong hands-on experience with AWS.
 * Strong experience with Databricks.
 * Strong hands-on experience with PySpark / Apache Spark.
 * Strong Python programming experience.
 * Strong SQL skills.
 * Experience developing enterprise-scale ETL/ELT pipelines.
 * Experience with AWS S3 and AWS data services.
 * Experience with Delta Lake.
 * Experience working with large-scale datasets.
 * Strong understanding of data lake/lakehouse architecture.
 * Experience with Spark performance tuning and optimization.
 * Experience with Git and CI/CD.

AWS Skills

Candidates should have hands-on experience with AWS services such as:

 * Amazon S3
 * AWS Glue
 * AWS Lambda
 * Amazon Redshift
 * Amazon EMR
 * AWS CloudWatch
 * AWS IAM

Preferred Skills

 * Databricks certification
 * Experience with Unity Catalog
 * Experience with Airflow
 * Experience with Kafka
 * Experience with AWS Glue/Airflow orchestration
 * Experience with Terraform
 * Experience with data governance and data quality frameworks

## Description

We are seeking an experienced Data Engineer with strong hands-on expertise in AWS, Databricks, PySpark, and Python. The ideal candidate will have experience designing and developing scalable data pipelines and data processing solutions using AWS cloud services and Databricks., * Design, develop, and maintain scalable data pipelines using Databricks, PySpark, Python, and AWS.

 * Develop robust ETL/ELT pipelines for ingesting and transforming large volumes of data.
 * Build and optimize PySpark/Spark SQL jobs within Databricks.
 * Work with AWS S3 for data storage and data lake solutions.
 * Develop data processing workflows using Databricks Workflows and related AWS services.
 * Work with Delta Lake for reliable data storage, incremental processing, and data transformation.
 * Develop reusable Python frameworks and utilities for data engineering processes.
 * Perform data validation, quality checks, error handling, and reconciliation.
 * Troubleshoot production pipeline issues and perform Root Cause Analysis (RCA).
 * Optimize Spark jobs for performance, scalability, and cost efficiency.
 * Integrate data from databases, APIs, files, and other enterprise data sources.
 * Implement CI/CD and source-control practices for data engineering applications.
 * Collaborate with Data Architects, Data Scientists, Analysts, and business stakeholders.
 * Participate in design, development, testing, deployment, and production support.


## Related Videos

- [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works)
- [PySpark - Combining Machine Learning & Big Data](https://www.wearedevelopers.com/videos/44-pyspark-combining-machine-learning-big-data)
- [Data Science in Retail](https://www.wearedevelopers.com/videos/586-data-science-in-retail)
- [Alibaba Big Data and Machine Learning Technology](https://www.wearedevelopers.com/videos/37-alibaba-big-data-and-machine-learning-technology)
- [How a Small Team Shrank a Microsoft Monorepo by 94%](https://www.wearedevelopers.com/videos/1236-how-a-small-team-shrank-a-microsoft-monorepo-by-94)
- [Enjoying SQL data pipelines with dbt](https://www.wearedevelopers.com/videos/823-enjoying-sql-data-pipelines-with-dbt)

## Related Articles

- [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers)
- [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk)
- [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know)
- [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story)
- [Coffee with Developers - Maria Apazoglou - Making AI understandable for all in production](https://www.wearedevelopers.com/magazine/475-coffee-with-developers-maria-apazoglou-making-ai-understandable-for-all-in-production)
- [Dev Digest 121 - AI goes offline](https://www.wearedevelopers.com/magazine/456-dev-digest-121-ai-goes-offline)