Senior Data Engineer - Remote

VYTWO TECHNOLOGIES INC.
Prosper, TX, United States
3 days ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
7 years minimum
Working hours
Regular working hours
Job source

Tech stack

Airflow Amazon Web Services Data Analysis Application Integration Architecture Automation of Tests Microsoft Azure Cloud Computing Code Review Continuous Integration Information Engineering Data Governance Extract Transform Load (ETL)
+35 more
Data Security Data Systems Data Warehousing Database Queries DevOps Distributed Systems Python (Programming Language) Metadata Standards Online Analytical Processing Online Transaction Processing Operational Databases Performance Tuning Standard Sql Software Engineering SQL Stored Procedures Workflow Management Systems Enterprise Data Management Cloud Platform System Sql Optimization Fast Healthcare Interoperability Resources Snowflake Containerization Data Lakes Pyspark Kubernetes Data Lineage Collibra Health Level Seven International Integration Frameworks Machine Learning Operations Software Version Control Data Pipelines Docker Databricks Programming Languages

Job description

Design, develop, and maintain scalable data pipelines using Python, PySpark, and other modern programming languages to support both batch and streaming workloads. Build and optimize data processing frameworks on cloud platforms such as Databricks or Snowflake, ensuring performance, reliability, and cost efficiency Design and implement robust data models, including transactional (OLTP) and dimensional (OLAP) schemas, to support analytics, reporting, and application integration Develop high quality SQL code including complex queries, stored procedures, and views, with a focus on performance tuning and efficient data access patterns Create and manage workflow orchestration using Apache Airflow or similar tools, ensuring reliable scheduling, dependency management, and monitoring Implement and enforce data governance and metadata standards through tools such as Microsoft Purview, including data lineage, classification, cataloging, and security policies Build automated data quality and validation frameworks to ensure accuracy, completeness, and reliability of production datasets Collaborate with cross functional teams including data architects, analysts, scientists, and business stakeholders to understand requirements and deliver scalable, well designed data solutions Lead technical design sessions and code reviews, promoting engineering best practices, reusability, and maintainability Support cloud infrastructure and DevOps practices, including CI/CD pipelines, version control, testing automation, and environment management Monitor and troubleshoot production data pipelines, proactively addressing issues, performance bottlenecks, and system failures Contribute to the evolution of the enterprise data platform, recommending tools, frameworks, and architectures to improve scalability and efficiency You’ll be rewarded and recognized for your performance in an environment that will challenge you and give you clear direction on what it takes to succeed in your role as well as provide development for other roles you may be interested in.

Requirements

7+ years of experience in data engineering, software engineering, or similar disciplines Hands-on experience with Databricks or Snowflake Experience with orchestration tools such as Apache Airflow Experience working with cloud ecosystems (Azure preferred; AWS/GCP acceptable) Advanced SQL skills and experience with OLTP and OLAP data modeling Solid understanding of modern data warehousing, data lake, and ELT/ETL design patterns Familiarity with data governance tools, especially Microsoft Purview Solid programming expertise in Python, PySpark, or similar languages If you are offered this position, you will be required to provide extensive personal information to obtain and maintain a suitability or determination of eligibility for a Confidential/Secret or Top Secret security clearance as a condition of your employment Must be a US Citizen Preferred Qualifications: Healthcare industry experience, including claims, clinical, FHIR, HL7, or provider data Experience with containerization (Docker, Kubernetes) for data workloads Experience supporting machine learning workflows or analytical data science pipelines Knowledge of distributed computing concepts and performance tuning

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.wayup.com

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

2:15 min

Empowering domain teams with an open data platform

Sandhya Menon Sandhya Menon · WWC Europe 2026

3:09 min

Balancing data science skillings alongside systems engineering rigor

Nico Schmidt · LIVE

2:07 min

Inspecting default bridge architectures and custom Docker networks

Oliver Seitz Oliver Seitz · WWC 2025

2:17 min

Mapping the maturity roadmap for scaled devops adoption

Dominik Krichbaum Dominik Krichbaum · WWC Europe 2026

2:57 min

Core technical practices for robust data engineering

Sandhya Menon Sandhya Menon · WWC Europe 2026

2:34 min

Docker sandbox architecture and microVM environment integration

Manuel de la Peña Manuel de la Peña · WWC Europe 2026

Videos

See all

Related articles

See all