> Markdown version of [/jobs/ext/257132-principal-data-engineer](https://www.wearedevelopers.com/jobs/ext/257132-principal-data-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Principal Data Engineer - **Company:** Lantern - **Location:** Dallas, TX, United States - **Experience:** Experienced - **Contract:** Permanent contract - **Skills:** Multitier Architecture, Application Programming Interfaces (APIs), Artificial Intelligence, Big Data, Code Coverage, Databases, Continuous Integration, Information Engineering, Data Governance, Data Infrastructure, Data Visualization, Data Warehousing, Distributed Data Store, Electronic Data Interchange (EDI), Identity and Access Management, Mobile Application Software, JSON, Python (Programming Language), Machine Learning, NoSQL, Object-Oriented Software Development, Fast Healthcare Interoperability Resources, Apache Spark, Data Strategy, Data Lakes, Integration Tests, Information Technology, Health Level Seven International, Apache Kafka, Restful APIs, Data Pipelines, Databricks, Programming Languages - **Published:** May 13, 2026 - **Apply:** https://www.indeed.com/viewjob?jk=5527f9ea39493a2e ## About the Role Do you have experience in Team management?, * You use LOGIC in your decision making and understand that progress is critical to making change. You focus on the execution of your content while balancing a fast-paced environment and you take the time to celebrate both the small & big wins. * INCLUSION is a core tenant of your personal beliefs. A diverse and inclusive environment is incredibly important to you. You understand and desire to be a part of a diverse team with different experiences and perspectives & you cherish the differences in each individual that you interact with. * You have the GRIT, drive and ambition to tackle big problems. Big problems require big ideas and a team that supports new ideas. * You care deeply for your customers are driven to keep HUMANITY in all decisions. Your customers aren't just the individuals using your product. They are the driving factor in your motivation to make a change. * Integrity guides you in life. Focusing on the TRUTH vs. giving people the answers they want to hear. * You thrive in a Team Environment. Collaboration is key in innovation and creating change., * Bachelor's or master's degree in computer science, Engineering, or a related field. * 12+ years of experience in Data Engineering, with at least 5+ years as Principal Engineer. * 5+ years of experience with programming languages (Python, Scala etc.), with a deep understanding of Spark and Databricks, and ability to optimize and performance tune the pipelines. * 3+ years of working with EDI or HIE standards (e.g. X12, HL7, and/or FHIR). * Proven leadership experience managing and developing data engineering teams, including team growth, skill development, and strategic project execution. * Prior experience with designing and managing large scale data infrastructure. * Expertise with cloud platforms, databases, and modern data stack with proficiency in Distributed Data Systems (e.g. Kafka, NoSQL). * Experience in building data lakes to support high speed querying by the end users. * Knowledge of AI/ML technologies to support various business use cases. * Knowledge of OOA/D and N-tier web or mobile applications best practices * Strong communication skills, with the ability to convey complex technical concepts to non-technical stakeholders. * Experience or knowledge with creating RESTful API's and data visualizations. Strong Candidates will have: * Healthcare Experience at Industry leading payors/insurers. * Prior implementation experience with Data Governance, and Patient Identity management in a healthcare setting. * Adopted a robust CI/CD driven engineering culture with focus on code coverage, unit and integration tests. ## Description * Architect and build platform foundations, including Observability, lineage, Quality Control Frameworks, while ensuring scalability, performance, and security. * Modularize platform frameworks to support diverse data needs, a variety of data formats (EDI, API, JSON, etc.), and deliver batch and real-time insights. * Collaborate with Data Engineers, Architects, and Business Analysts in building pipelines and data models to improve the reliability and interpretability of data for analytical and business needs. * Build technical design documents, evaluate emerging technologies, and lead proof-of-concept initiatives to validate solutions. * Champion software engineering best practices, including code standards, effective review processes, CI/CD, and Data Infrastructure. * Evolve platform capabilities to integrate ML and AI Models to accelerate business use cases. * Adopt an iterative product development mindset to solve for challenges on the platform. * Partner with business stakeholders and technology leadership to define Data Strategy, Roadmap, and hiring for future needs. * Foster a positive team environment that embraces continuous learning and technical innovation. * Mentor team members and build a high-performance engineering culture through collaboration and knowledge sharing. ## Related Videos - [Alibaba Big Data and Machine Learning Technology](https://www.wearedevelopers.com/videos/37-alibaba-big-data-and-machine-learning-technology) - [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works) - [Tips and Tricks for Working with JSON](https://www.wearedevelopers.com/videos/1229-tips-and-tricks-for-working-with-json) - [Leveraging Real time data in FSIs](https://www.wearedevelopers.com/videos/806-leveraging-real-time-data-in-fsis) - [Blueprints for Success: Steering a Global Data & AI Architecture](https://www.wearedevelopers.com/videos/1577-blueprints-for-success-steering-a-global-data-ai-architecture) - [Introducing JSON Structure](https://www.wearedevelopers.com/videos/100219-introducing-json-structure) ## Related Articles - [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers) - [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk) - [The Biggest German Tech Companies](https://www.wearedevelopers.com/magazine/424-the-biggest-german-tech-companies) - [Coffee with Developers - Maria Apazoglou - Making AI understandable for all in production](https://www.wearedevelopers.com/magazine/475-coffee-with-developers-maria-apazoglou-making-ai-understandable-for-all-in-production) - [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know) - [Navigating the AI Shift](https://www.wearedevelopers.com/magazine/629-navigating-the-ai-shift)