> Markdown version of [/jobs/ext/3034859-sr-data-engineer](https://www.wearedevelopers.com/jobs/ext/3034859-sr-data-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Sr Data Engineer - **Company:** XCEED SEARCH PARTNERS, LLC - **Location:** Scottsdale, AZ, United States - **Experience:** Expert - **Contract:** Permanent contract - **Skills:** Third Normal Form, Application Programming Interfaces (APIs), Airflow, Amazon Web Services, Amazon S3, Big Data, Data Architecture, Data Validation, Information Engineering, Data Governance, Data Warehousing, JSON, Python (Programming Language), MongoDB, Online Transaction Processing, PCI Data Security Standards, SQL Databases, Systems Integration, Tableau (Software), Talend, Cloud Platform System, Snowflake, Data Lakes, Semi-structured Data, Information Technology, Star Schema, AWS Data Analytics, Data Pipelines, Databricks - **Published:** September 23, 2026 - **Apply:** https://jobs.smartrecruiters.com/XceedSearchcom/744000151141289-sr-data-engineer ## About the Role * Bachelor's degree in Computer Science, Information Technology, or equivalent experience. * 10+ years of experience in data engineering. * Mastery of complicated SQL for loading data, including complex joins, subqueries, windowing functions, and common table expressions. * Advanced proficiency in Python, developing and supporting robust pipelines, frameworks, and automation solutions. * Proven history designing and managing Data Warehousing solutions including proper loading techniques, star schema modeling, slowly changing dimensions, and aggregate strategies. * Strong understanding of OLTP modeling (3NF) and how to denormalize for performance or downstream use. * Production experience with unstructured and semi-structured data (e.g., JSON, MongoDB, APIs) and integrating it into enterprise data ecosystems. * Practical expertise implementing and optimizing pipeline orchestration with tools such as Airflow or Prefect. * Experience implementing and optimizing 3rd party transformation tools such as dbt, Talend, or FiveTran. * Demonstrated success in delivering scalable solutions using cloud-based data platforms like Snowflake or Databricks. * Applied experience leveraging AWS data services (S3, Glue, Redshift, Lambda, Secrets Manager, etc.) in secure and cost-effective ways. * Demonstrated ability to ensure compliance with regulatory requirements including PCI-DSS, GDPR, CPRA, CCPA, and SOX. * Effective communication skills for engaging both technical and non-technical audiences and collaborating with business and audit stakeholders. * Proven capability mentoring peers, promoting best practices, and contributing to team growth. * High adaptability to changing requirements, emerging technologies, and competing priorities. * Nice to have: Hands-on experience with Data Lake and Lakehouse technologies (e.g., Delta Lake, Iceberg, Hudi) for managing large-scale data assets. This role is critical to our data engineering practice. We are looking for a hands-on leader who can operate in both structured and fast-changing environments while delivering high-quality, scalable solutions. ## Description We are seeking a Senior Data Engineer with the technical expertise, architectural insight, and problem-solving skills to design, build, and maintain our modern data platform. The ideal candidate will be a hands-on engineer who can deliver at scale, ensure data quality, and work across teams to support both operational and analytical workloads., * Design, build, and maintain scalable data pipelines (ETL/ELT) for both batch and streaming use cases. * Implement data validation and integrity frameworks, ensuring accuracy, completeness, and reconciliation across systems. * Administer and optimize cloud-based data services (AWS, Snowflake, Databricks, etc.). * Ensure compliance with data governance and regulations (PCI-DSS, GDPR, CPRA, SOX, etc.). * Deliver proof of concepts and lightweight prototypes to validate architectural improvements. * Collaborate with business units, audit teams, and stakeholders to align data architecture with organizational needs. * Support reporting and analytics teams by enabling Tableau (or future-state tools) through well-structured data models and governance. * Seek out new work proactively and mentor other team members. * Own projects end-to-end and deliver measurable results. * Diagnose and resolve complex data issues quickly. ## Related Videos - [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works) - [Fully Orchestrating Databricks from Airflow](https://www.wearedevelopers.com/videos/336-fully-orchestrating-databricks-from-airflow) - [Tips and Tricks for Working with JSON](https://www.wearedevelopers.com/videos/1229-tips-and-tricks-for-working-with-json) - [Modern Data Architectures need Software Engineering](https://www.wearedevelopers.com/videos/1030-modern-data-architectures-need-software-engineering) - [Introducing JSON Structure](https://www.wearedevelopers.com/videos/100219-introducing-json-structure) - [AI Model Management Life Circles: ML Ops For Generative AI Models From Research to Deployment](https://www.wearedevelopers.com/videos/1152-ai-model-management-life-circles-ml-ops-for-generative-ai-models-from-research-to-deployment) ## Related Articles - [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk) - [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story) - [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers) - [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know) - [How We Built a Worry-Free System That Runs for 10+ Years – And What We’d Do Again](https://www.wearedevelopers.com/magazine/751-how-we-built-a-worry-free-system-that-runs-for-10-years-and-what-we-d-do-again) - [Résumé-Driven Development: How IT trends affect the job market for software developers](https://www.wearedevelopers.com/magazine/59-resume-driven-development-how-it-trends-affect-the-job-market-for-software-developers)