> Markdown version of [/jobs/ext/1898146-senior-data-engineer-data-architect-13886-in-houston](https://www.wearedevelopers.com/jobs/ext/1898146-senior-data-engineer-data-architect-13886-in-houston). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Senior Data Engineer / Data Architect -- 13886 in Houston - **Company:** Energy Jobline - **Location:** Houston, TX, United States - **Experience:** Expert - **Contract:** Permanent contract - **Skills:** JavaScript (Programming Language), .NET Framework, Application Programming Interfaces (APIs), Artificial Intelligence, Microsoft Azure, C Sharp (Programming Language), Software as a Service, Continuous Integration, Data Architecture, Data Validation, Data Governance, Data Migration, Data Structures, Data Systems, DevOps, Github, Python (Programming Language), Machine Learning, Power BI, Azure Data Lake, SQL Databases, SQL Server Reporting Services, Data Streaming, Tableau (Software), Enterprise Data Management, Sql Optimization, Apache Spark, Data Lakes, Pyspark, Data Lineage, Machine Learning Operations, Api Design, Software Version Control, Data Pipelines, Legacy Systems, Databricks - **Published:** August 2, 2026 - **Apply:** https://www.energyjobline.com/job/senior-data-engineer-data-architect-13886-houston-31313554 ## About the Role * 6+ years building data pipelines, data architecture, or enterprise data platforms * Direct hands-on background standing up cloud-based data pipelines * Prior work inside enterprise systems (ERP, CRM, or comparable platforms) * Strong Azure Databricks and Apache Spark chops * Solid Python/PySpark skills * Advanced SQL * Comfortable with Azure Data Lake Storage (ADLS) * CI/CD background using GitHub * Familiarity with API-driven and data integration patterns * Comfortable with both dimensional and normalized modeling approaches * Working knowledge of data governance and security, including access roles and lineage tracking * Delta Lake or broader Lakehouse experience is a plus * Any exposure to ML/AI pipelines or data science work is a plus * Manufacturing, oil & gas, or ERP-heavy backgrounds are a plus * Experience with C#, .NET, SQL, or JavaScript is a plus * DevOps and source control experience tied to ERP development is a plus * Understanding of cloud ERP platforms and migration paths is a plus * Power BI, SSRS, or Tableau exposure for integration/reporting is a plus Do not apply unless you are authorized to work in the United States for any employer as client company cannot sponsor or transfer visas at this time. ## Description * Develop batch and streaming pipelines in Databricks and Spark, moving data from source to consumption * Build out the medallion (Bronze/Silver/Gold) layer structure within the Lakehouse * Bring data in from ERP, SaaS tools, APIs, and older legacy platforms * Improve pipeline performance while keeping an eye on cost and scale * Set up CI/CD workflows through GitHub * Take ownership of data architecture direction and set the standards other teams build against * Create logical and physical data models spanning finance, operations, and field service * Lock in consistent definitions for shared entities like customer, job, and revenue * Shape data structures so they work equally well for BI reporting and AI/ML training * Run governance through Unity Catalog, covering access roles, lineage, and audit needs * Put standards in place for naming, permissions, and data quality checks * Keep HR and financial data protected in accordance with security policy * Build checks that catch data quality issues before they reach reporting or downstream systems * Design repeatable patterns for how data flows in, gets transformed, and gets consumed by BI tools, APIs, or AI models * Link Databricks into the broader Azure ecosystem (ADLS, internal APIs, enterprise apps) * Keep the platform observable, stable, and running smoothly * Get data ready for AI/ML consumption, including automation-focused use cases * Collaborate with analytics and AI groups on datasets built for predictive work * Sit with business and application teams to turn their needs into working data solutions * Set direction on engineering approach and architectural tradeoffs for the broader team * Coach junior team members and contractors as the group expands ## Related Videos - [Modern Data Architectures need Software Engineering](https://www.wearedevelopers.com/videos/1030-modern-data-architectures-need-software-engineering) - [PySpark - Combining Machine Learning & Big Data](https://www.wearedevelopers.com/videos/44-pyspark-combining-machine-learning-big-data) - [From DevOps to Scaled DevOps: How We’re Rebuilding Continuous Delivery as a Platform](https://www.wearedevelopers.com/videos/100018-from-devops-to-scaled-devops-how-we-re-rebuilding-continuous-delivery-as-a-platform) - [Innovating Developer Tools with AI: Insights from GitHub Next](https://www.wearedevelopers.com/videos/1268-innovating-developer-tools-with-ai-insights-from-github-next) - [Empowering Retail Through Applied Machine Learning](https://www.wearedevelopers.com/videos/976-empowering-retail-through-applied-machine-learning) - [Data Science in Retail](https://www.wearedevelopers.com/videos/586-data-science-in-retail) ## Related Articles - [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk) - [Is Software Engineering Over-Saturated?](https://www.wearedevelopers.com/magazine/418-is-software-engineering-over-saturated) - [The Most Popular IT Jobs on the Market](https://www.wearedevelopers.com/magazine/376-the-most-popular-it-jobs-on-the-market) - [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers) - [Where To Find Software Engineering Jobs](https://www.wearedevelopers.com/magazine/396-where-to-find-software-engineering-jobs) - [How to Become an AI Engineer](https://www.wearedevelopers.com/magazine/331-how-to-become-an-ai-engineer)