Lead Data Engineer
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Tech stack
Job description
We are seeking a hands-on Senior Data Engineer to develop and maintain an engineering metrics and analytics platform. The platform integrates data from multiple engineering and development systems to provide actionable insights into software delivery, engineering productivity, and operational performance., For consideration, candidates should provide examples of comparable projects, their specific technical contributions, and demonstrated proficiency in Python, SQL, data quality engineering, API integrations, and dashboard development.
Requirements
The ideal candidate will independently analyze complex datasets, build reliable data pipelines, identify and resolve data quality issues, and develop dashboards or lightweight applications to present meaningful business metrics., This role requires strong technical expertise, analytical problem-solving, end-to-end ownership, and the ability to mentor junior team members., Proven ability to work independently, solve complex technical problems, and provide guidance to junior engineers.
Benefits & conditions
n
-
\n Strong Python programming and advanced SQL skills. \n
-
\n Experience building ETL/ELT pipelines integrating multiple data sources, including structured and unstructured data. \n
-
\n Expertise in data transformation, aggregation, modeling, and pipeline optimization. \n
-
\n Experience integrating REST APIs, including authentication, pagination, rate limits, and error handling. \n
-
\n Ability to manage large datasets, incremental loads, and evolving source schemas. \n
Data Quality & Reliability\n \n
-
\n Experience implementing automated data validation, reconciliation, and quality checks. \n
-
\n Ability to identify and resolve missing, duplicate, inconsistent, or inaccurate records. \n
-
\n Strong root-cause analysis skills for investigating data discrepancies. \n
-
\n Experience developing monitoring, alerting, and exception reporting. \n
-
\n Understanding of data lineage, metric definitions, and consistency across multiple systems. \n
Data Analytics & Visualization\n \n
-
\n Ability to analyze complex datasets and derive actionable insights. \n
-
\n Experience defining, calculating, and validating KPIs using consistent business rules. \n
-
\n Strong analytical reasoning and troubleshooting skills. \n
-
\n Hands-on experience developing interactive dashboards using Grafana, Splunk, Power BI, or comparable visualization tools. \n
-
\n Ability to build visualizations, filters, drill-downs, and trend analysis. \n
-
\n Experience developing lightweight data applications using Python frameworks such as Streamlit, Dash, or equivalent technologies. \n
Engineering Practices & Technical Leadership\n \n
-
\n Strong debugging, testing, code review, documentation, and version control practices. \n
-
\n Ability to independently architect and deliver end-to-end data engineering solutions. \n
-
\n Experience mentoring junior engineers and establishing reusable development standards. \n
-
\n Ability to translate ambiguous business requirements into technical solutions. \n
-
\n Strong communication skills to explain technical findings and data quality concerns to stakeholders. \n
-
\n Familiarity with AI-assisted development tools and their application to engineering and visualization workflows. \n
Preferred Qualifications\n \n
-
\n Experience integrating engineering tools such as Jira, Bitbucket, GitLab, Jenkins, Splunk, and deployment platforms. \n
-
\n Understanding of software development lifecycle and delivery performance metrics, including DORA metrics. \n
-
\n Experience with cloud platforms, workflow orchestration, and production pipeline monitoring. \n
-
\n Background in engineering productivity analytics, DevOps analytics, or developer experience initiatives. \n
-
\n Experience developing executive-level reporting and visualization solutions. \n
About the company
Welcome to ConsultNet, a premier national provider of technology talent and solutions. Our expertise spans across project services, contract-to-hire, direct search, and managed services onshore, nearshore, and hybrid. For over 25 years, we have connected thousands of consultants with meaningful roles through a personal, communication-driven approach, partnering with a diverse client base to build high-performing teams and create lasting impact. Our comprehensive service offerings cover a wide range of technology and engineering positions across key markets nationwide. Learn more at www.consultnet.com .
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Good distractions
Loading talks and stories from around this roleβ¦