> Markdown version of [/jobs/ext/2025455-data-engineer](https://www.wearedevelopers.com/jobs/ext/2025455-data-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Data Engineer - **Company:** Gtech LLC - **Location:** Frisco, TX, United States - **Experience:** Expert - **Contract:** Temporary contract - **Skills:** Artificial Intelligence, Application Frameworks, Audit Trail, Microsoft Azure, Big Data, Cloud Computing, Code Generation, Code Review, Computer Engineering, Continuous Integration, Data Architecture, Information Engineering, Data Governance, Data Infrastructure, Data Integration, Extract Transform Load (ETL), Data Transformation, Data Migration, Data Security, Data Structures, Data Warehousing, Relational Databases, Cursor (Graphical User Interface Elements), Software Debugging, Software Design Patterns, Python (Programming Language), NoSQL, Oracle (Applications), Productivity Software, Queueing Systems, Power BI, Cloud Services, Standard Sql, Azure Data Lake, SQL Stored Procedures, SQL Databases, Data Streaming, Systems Integration, Data Storage Management, Data Ingestion, Azure Data Factory, Large Language Models, Snowflake, Prompt Engineering, Apache Spark, Generative AI, Gitlab, Build Management, Core Data, Information Technology, Apache Flink, Apache Kafka, Virtual Agents, Data Delivery, Stream Processing, Data Pipelines, Databricks - **Published:** August 11, 2026 - **Apply:** https://www.dice.com/job-detail/aefc8f21-168e-48b3-82e5-ab8199c7dee2 ## About the Role Bachelor's degree in computer science, Computer Engineering, or a related field 5 7 years of hands-on experience designing, building, and supporting data engineering and ETL solutions Ability to write complex, highly performable, scalable, large volume handling SQLs, stored procedures. Strong experience developing and migrating data solutions in Azure Strong experience in building data engineering solutions using Azure Flink, dbt and any open-source frameworks to build vendor agnostic technology solutions. Demonstrated experience in data pipelines and ETL development using Azure Data Factory, Databricks, ADLS, Oracle, Snowflake, and Python Strong experience in developing CI/CD solutions using Azure DevOps or gitlab Strong analytical and problem-solving skills applied to complex data ingestion and integration challenges Ability to manage multiple workstreams with strong organizational and prioritization skills Passion for learning and applying new data engineering technologies and design patterns. Familiarity with foundation models, prompt engineering, retrieval-augmented generation (RAG), and AI agent development applied to data engineering use cases, including privacy and enterprise reusable solutions Must Have Skills Advanced experience designing, building, and optimizing complex data pipelines using Azure Data Factory, Databricks, ADLS, Oracle, Snowflake, and Python Hands-on experience with cloud-native data platforms and services, including Azure, Databricks, and Snowflake Strong experience with SQL, NoSQL, and relational database design and development Working knowledge of message queuing, stream processing using Kafka. Hands-on experience with AI productivity tools (Claude and Cursor or similar IDE) and working knowledge of foundation models, prompt engineering, retrieval-augmented generation (RAG), and AI agent development. Nice to Have Cloud or data platform certifications such as Microsoft Azure Data Engineer (DP-203), Snowflake, or Databricks Experience developing reports using Power BI. ## Description Sr Engineer, Data is responsible for designing and developing scalable data architectures and ingestion pipelines across on-premises, cloud, and hybrid platforms to support enterprise data and analytics needs. This role collaborates closely with data engineers to analyze, architect, design, and deliver data warehouse and business analytics solutions. The Sr Engineer designs and implements complex data pipelines, optimizes data delivery, and automates manual processes using Azure Data Factory, Databricks, ADLS, Snowflake, Oracle, Python, SQL, and Azure. The role includes mentoring team members to strengthen data engineering capabilities and drive technical excellence. Success is measured by the effectiveness of data engineering solutions, team skill development, and contributions to data architecture innovation that enable data-driven decision-making and developing privacy compliance solutions at scale. What You'll Do Design and build scalable data pipelines using Azure Data Factory for seamless data integration across diverse sources. Mastery of SQL for efficient data querying and manipulation. Analyze complex datasets to identify data anomalies, trends and actionable insights. Strong data modeling skills to design and optimize data structures. Implement data ingestion and transformations using Snowflake features like Stored Procedures, Streams, Tasks, Snowpipe, Iceberg Tables, Dynamic Tables, Storage Integrations and Views. Manage and optimize Azure Data Lake Storage (ADLS) for secure, scalable and high-performance data storage and retrieval. Design and build scalable big data processing workflows using Azure Databricks with Unity Catalog to ensure secure, governed data access. Leverage Apache Spark for advanced data transformation and optimize cluster configurations for performance and cost efficiency. Familiarity with the Azure cloud platform to leverage its services and tools. Diagnose and resolve issues within data pipelines to ensure smooth data flow. Tune SQL queries and pipelines for performance and cost efficiency. Optimize data pipelines to improve data delivery, reliability, and performance Ensure data quality by implementing validation, cleansing and monitoring mechanisms. Ensure data governance and compliance with privacy regulations. Effective communication and collaboration skills to work seamlessly with cross-functional teams. Adaptability to work in a fast-paced and evolving environment to meet dynamic business needs. Daily use of AI productivity tools (current stack: Claude, and Cursor or similar IDE) is required for core data engineering activities including pipeline development, SQL authoring, code generation, code review, debugging, testing, and documentation. Design, build, and operate AI agents to automate privacy data engineering solutions. Apply foundation models, prompt engineering, and retrieval-augmented generation (RAG) patterns to privacy data engineering use cases. Implement audit logging, observability, and human-in-the-loop controls for AI agents and AI-assisted workflows in privacy data engineering. ## Related Videos - [Beyond Dashboards: Fixing Text-to-SQL with Semantic RAG](https://www.wearedevelopers.com/videos/2036-beyond-dashboards-fixing-text-to-sql-with-semantic-rag) - [WeAreDevelopers LIVE - Modern DevOps for IoT Devices and More](https://www.wearedevelopers.com/videos/1805-wearedevelopers-live-modern-devops-for-iot-devices-and-more) - [Leveraging Real time data in FSIs](https://www.wearedevelopers.com/videos/806-leveraging-real-time-data-in-fsis) - [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works) - [Enjoying SQL data pipelines with dbt](https://www.wearedevelopers.com/videos/823-enjoying-sql-data-pipelines-with-dbt) - [Data Analytics with Microsoft Fabric: End-to-End Use Case with Data Agents](https://www.wearedevelopers.com/videos/1547-data-analytics-with-microsoft-fabric-end-to-end-use-case-with-data-agents) ## Related Articles - [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk) - [What Are The Top Skills Required For Azure Developers?](https://www.wearedevelopers.com/magazine/77-what-are-the-top-skills-required-for-azure-developers) - [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers) - [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know) - [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story) - [How to Become an AI Engineer](https://www.wearedevelopers.com/magazine/331-how-to-become-an-ai-engineer)