> Markdown version of [/jobs/ext/4790162-senior-technical-lead](https://www.wearedevelopers.com/jobs/ext/4790162-senior-technical-lead). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Senior Technical Lead - **Company:** HCL Technologies - **Location:** Troy, MI, United States - **Experience:** Expert - **Contract:** Permanent contract - **Skills:** Data Analysis, Microsoft Azure, Cloud Computing, Cyber Security, Computer Programming, Databases, Information Engineering, Data Files, Extract Transform Load (ETL), Data Transformation, Data Security, Data Systems, Data Virtualization, Document-Oriented Databases, Python (Programming Language), Systems Development Life Cycle, DataOps, SQL Databases, Cloud Platform System, Reliability of Systems, Information Technology, Data Management, Data Pipelines, Databricks - **Published:** November 19, 2026 - **Apply:** https://www.careerbuilder.com/job-details/senior-technical-lead-troy-mi--9472c89b-7f99-4614-ac65-d6ff32962021 ## About the Role Technical Leadership, Technical Leadership, Data Sets, Data Quality, Data Management, Database Extract Transform and Load (ETL), Cloud Computing, Data Analysis, Information/Data Security (InfoSec), Scalable System Development, * Degree in Computer Science, Data Engineering, Information Technology or a related field * A minimum of 5 years of professional experience in data engineering or a related role * Proven experience as a Data Engineer with a focus on Databricks * Strong programming skills in SQL and Python * Experience with cloud computing platforms (preferably Microsoft Azure) * Ideally Experience with data virtualization tools (Denodo) * Strong problem-solving and analytical skills * Proficiency in CDC ingestion patterns (watermarks, change tables, log-based ingestion). * Advanced error handling & observability * Excellent communication and teamwork abilities * A passion for working with data and a desire to continuously learn and improve * Excellent English skills. German skills are a bonus * Microsoft Azure or Databricks certifications are a plus ## Description Data Engineer (Databricks) designs and maintains scalable, reliable data pipelines that transform raw data into analytics-ready datasets for reporting and decision-making. The role ensures high data quality, security, and performance across cloud-based ETL workflows, while collaborating closely with analytics and business teams to enable trusted, data-driven insights., * Design, develop, and maintain scalable data pipelines and ETL processes * Implement ETL processes to ingest, transform, and load data from various sources * Ensure data quality, security, and compliance * Optimize and fine-tune data systems for performance and scalability * Develop and document data architecture and processes * Collaborate with data scientists and analysts to understand data requirements * Work closely with cross-functional teams to support data-driven decision-making * Monitor and troubleshoot data pipeline issues * Troubleshoot and resolve data-related issues and support users * Monitor ETL processes, proactively identifying and resolving issues or performance bottlenecks to maintain high system reliability. * Review data transformation and ingestion patterns, including CDC, schema evolution, and error handling for robust data operations. * Document ETL workflows, data mappings, and process changes to ensure transparency and clear communication across technical and non-technical teams. * Stay updated with the latest features and best practices