> Markdown version of [/jobs/ext/3419469-senior-data-engineer](https://www.wearedevelopers.com/jobs/ext/3419469-senior-data-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Senior Data Engineer - **Company:** Specialty Cores Inc - **Location:** Dallas, TX, United States - **Experience:** Expert - **Contract:** Permanent contract - **Skills:** Microsoft Access, Artificial Intelligence, Amazon Web Services, Microsoft Azure, Big Data, Continuous Integration, Information Engineering, Data Governance, Data Systems, Data Vault Modeling, Data Warehousing, Software Design Patterns, Distributed Computing Environment, Github, Python (Programming Language), Machine Learning, Cloud Services, Reverse Engineering, Scala (Programming Language), SQL Databases, Software Technical Review, Snowflake, Build Management, Data Lakes, Data Management, Software Coding, Terraform, Azure Synapse Analytics, Data Pipelines, Databricks, Programming Languages - **Published:** September 13, 2026 - **Apply:** https://www.indeed.com/viewjob?jk=b44d832238c13ae8 ## About the Role * Deep expertise in data pipeline design, optimization, and distributed data processing architectures with experience identifying and resolving performance and scalability bottlenecks * Strong knowledge of cloud data platforms (AWS, Azure, or GCP) and modern data warehouse/Lakehouse architectures (Delta Lake, Iceberg) * Strong working proficiency with at least two programming languages (Python, Scala, SQL) * Solid understanding of data governance, security, and compliance practices in a regulated or enterprise environment * Ability to troubleshoot and reverse engineer existing codebases and data pipeline * Working knowledge of how data platforms enable AI/ML solutions, Applicants must be authorized to work for any employer in the U.S. We are unable to sponsor or take over work authorization sponsorship now or in the future for this position. * Bachelor's degree in related field or demonstrated equivalent experience in a related field required. * 7+ years of experience in data engineering, with experience working on large-scale, mature data platforms. * Demonstrated experience taking technical ownership of complex projects from design through delivery. * Experience contributing to data platforms that support downstream AI/ML use cases (e.g., feature stores, curated/governed datasets, streaming access for model training and inference). * Experience with IAC and CI/CD practices for data systems (i.e. Terraform, GitHub Actions) * Strong experience writing code modular code with notebooks * Platforms: Hands on experience with Snowflake or Databricks, Azure Synapse Analytics/MS Fabric * Experience mentoring or informally guiding other engineers, even without formal people management responsibility. * Experience optimizing the developer experience * Experience designing or implementing Agentic workflows for data engineering preferred * Experience working with Property & Casualty insurance carriers preferred * Experience with Data Vault 2.0 or Ensemble data modeling techniques preferred ## Description Reporting directly to the Director, Data Engineering, you will work alongside a small, focused team to build reliable, scalable data products and maintain a high-performing platform that supports evolving analytics and AI/ML needs. This role is well suited to an experienced data engineer seeking significant hands-on ownership, along with opportunities to mentor others and influence technical practices across the team., Hands-On Engineering & Technical Ownership * Design, build, and optimize data pipelines, ingestion frameworks, and platform components that support analytics, reporting, and downstream AI/ML use cases. * Take direct ownership of high-complexity or high-risk engineering initiatives, from technical design through implementation and rollout. * Identify and resolve performance, scalability, and reliability bottlenecks across the existing data platform. * Contribute to the platform's AI/ML readiness by improving data models, governance, and access patterns (e.g., feature stores, curated datasets, streaming access). * Diagnose and resolve complex production issues, including on-call support for critical data pipeline failures. * Write clean, well-tested, well-documented code and infrastructure-as-code, and maintain strong engineering hygiene across your work. Technical Leadership & Collaboration * Act as a senior technical resource for the team, providing guidance on architecture, design patterns, and best practices. * Conduct code and design reviews, helping raise the technical bar across the Data Engineering team. * Partner closely with the Director, Data Engineering on technical design decisions, tooling evaluations, and platform roadmap input. * Mentor other data engineers, sharing knowledge and helping develop their technical skills. * Partner cross-functionally with Product and Engineering stakeholders to understand data needs and translate them into technical solutions. * Help document standards, runbooks, and architectural decisions to support team scalability and knowledge sharing. * Other duties as assigned. ## Related Videos - [Alibaba Big Data and Machine Learning Technology](https://www.wearedevelopers.com/videos/37-alibaba-big-data-and-machine-learning-technology) - [Innovating Developer Tools with AI: Insights from GitHub Next](https://www.wearedevelopers.com/videos/1268-innovating-developer-tools-with-ai-insights-from-github-next) - [Infrastructure as Code: The Developer's Secret Weapon](https://www.wearedevelopers.com/videos/1221-infrastructure-as-code-the-developer-s-secret-weapon) - [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works) - [Bringing AI Model Testing and Prompt Management to Your Codebase with GitHub Models](https://www.wearedevelopers.com/videos/1536-bringing-ai-model-testing-and-prompt-management-to-your-codebase-with-github-models) - [PySpark - Combining Machine Learning & Big Data](https://www.wearedevelopers.com/videos/44-pyspark-combining-machine-learning-big-data) ## Related Articles - [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers) - [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story) - [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk) - [Coffee with Developers - Maria Apazoglou - Making AI understandable for all in production](https://www.wearedevelopers.com/magazine/475-coffee-with-developers-maria-apazoglou-making-ai-understandable-for-all-in-production) - [How We Built a Worry-Free System That Runs for 10+ Years – And What We’d Do Again](https://www.wearedevelopers.com/magazine/751-how-we-built-a-worry-free-system-that-runs-for-10-years-and-what-we-d-do-again) - [How to Become an AI Engineer](https://www.wearedevelopers.com/magazine/331-how-to-become-an-ai-engineer)