> Markdown version of [/jobs/ext/729992-data-engineer](https://www.wearedevelopers.com/jobs/ext/729992-data-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Data Engineer - **Company:** Intellisoft Inc - **Location:** Malvern, PA, United States - **Experience:** Expert - **Contract:** Temporary contract - **Skills:** Airflow, Amazon Web Services, Amazon S3, Business Analytics Applications, Apache HTTP Server, Big Data, Continuous Integration, Directed Acyclic Graph (Directed Graphs), Information Engineering, Data Governance, Extract Transform Load (ETL), Data Systems, Data Warehousing, Dimensional Modeling, Github, Apache Hive, Identity and Access Management, Python (Programming Language), Performance Tuning, Query Optimization, Workflow Management Systems, Cloud Platform System, Delivery Pipeline, Snowflake, Electronic Medical Records, Cloudformation, Data Lakes, Pyspark, Semi-structured Data, Information Technology, Deployment Automation, AWS Glue, Star Schema, Functional Programming, Cloudwatch, Terraform, Data Pipelines, Jenkins, Amazon Redshift, Databricks - **Published:** June 29, 2026 - **Apply:** https://www.dice.com/job-detail/b5c78f91-b3f2-48cc-9ba1-d1f0f89577e6 ## About the Role MUST HAVE 12 YEARS OF IT EXPERIENCE AND QUICK SIGHT EXPERIENCE * Senior Data Engineer with 12+ years of experience designing and delivering enterprise-scale data warehousing, ETL/ELT, and cloud-native analytics solutions using AWS Redshift, S3, Glue, Lambda, Airflow, PySpark, and Python. * Strong hands-on expertise with Amazon Redshift, including schema design, distribution keys, sort keys, query optimization, workload management, Redshift Spectrum integration, and performance tuning for large-scale analytical workloads. * Designed and implemented scalable ETL/ELT pipelines using AWS Glue, PySpark, Python, Airflow, Lambda, and S3, enabling efficient ingestion, transformation, and processing of high-volume structured and semi-structured data. * Extensive experience in advanced SQL development, data modeling, dimensional modeling (Star/Snowflake Schemas), data warehousing, and optimization of complex analytical queries supporting enterprise reporting and business intelligence. * Strong AWS experience with S3, Glue, Lambda, IAM, CloudWatch, EMR, Athena, EventBridge, and Redshift, building secure, scalable, and highly available cloud-based data platforms. * Developed and optimized large-scale data processing solutions using PySpark, Spark SQL, Databricks, and EMR, improving processing performance, scalability, and cost efficiency across enterprise data ecosystems. * Built and maintained Apache Airflow DAGs for workflow orchestration, scheduling, dependency management, monitoring, and automated recovery of complex data pipelines. * Experienced in modern Data Lake and Lakehouse architectures leveraging S3, Delta Lake, Apache Iceberg, Snowflake, and Databricks, supporting scalable analytics and data governance initiatives. * Implemented CI/CD and Infrastructure as Code solutions using Terraform, GitHub Actions, Jenkins, AWS CodePipeline, and CloudFormation, enabling automated deployment and management of data engineering workloads. * Proven ability to collaborate with cross-functional teams to deliver robust, high-performance data solutions that support analytics, reporting, operational intelligence, and business-critical decision-making. ## Related Videos - [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works) - [Innovating Developer Tools with AI: Insights from GitHub Next](https://www.wearedevelopers.com/videos/1268-innovating-developer-tools-with-ai-insights-from-github-next) - [The Road to MLOps: How Verivox Transitioned to AWS](https://www.wearedevelopers.com/videos/1050-the-road-to-mlops-how-verivox-transitioned-to-aws) - [Enjoying SQL data pipelines with dbt](https://www.wearedevelopers.com/videos/823-enjoying-sql-data-pipelines-with-dbt) - [Our GitOps approach for deploying an Identity Provider and an API Gateway in a SaaS company](https://www.wearedevelopers.com/videos/776-our-gitops-approach-for-deploying-an-identity-provider-and-an-api-gateway-in-a-saas-company) - [AI Model Management Life Circles: ML Ops For Generative AI Models From Research to Deployment](https://www.wearedevelopers.com/videos/1152-ai-model-management-life-circles-ml-ops-for-generative-ai-models-from-research-to-deployment) ## Related Articles - [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story) - [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk) - [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know) - [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers) - [What Are The Top Skills Required For Azure Developers?](https://www.wearedevelopers.com/magazine/77-what-are-the-top-skills-required-for-azure-developers) - [The Most Popular IT Jobs on the Market](https://www.wearedevelopers.com/magazine/376-the-most-popular-it-jobs-on-the-market)