Senior Data Engineer

The Senior Data Engineer leads ETL/ELT dependencies, readiness-system integrations, data mappings, transformation logic, repository coordination, and versioned engineering documentation for A2FF ISR readiness data products. The role supports DRRS, DEERS, Envision, ASERT, and other Government-designated readiness data sources by developing reliable data pipelines, maintaining source-to-target traceability, documenting processing logic, supporting quality checks, and ensuring engineering outputs are ready for Government review and downstream analytic, dashboard, and reporting use. This position is contingent based on award., READINESS DATA INTEGRATION AND SOURCE SYSTEM ENGINEERING

• Lead technical engineering support for updated and fully functional data integrations across DRRS, DEERS, Envision, ASERT, and other Government-designated readiness systems.
• Analyze source-system dependencies, data availability, access constraints, integration points, refresh requirements, and downstream analytic or dashboard impacts.
• Develop, maintain, and update source-to-target data mappings that identify data elements, authoritative sources, transformation rules, business logic, and readiness product dependencies.
• Coordinate with readiness, data governance, dashboard, and analytic personnel to ensure integrated data products support repeatable readiness assessments and decision-support outputs.

ETL/ELT PIPELINE DEVELOPMENT AND REPOSITORY DISCIPLINE

• Develop, update, test, and maintain ETL/ELT pipelines supporting readiness data collection, transformation, integration, and delivery into Government-approved environments and repositories.
• Commit pipeline updates, scripts, configuration files, engineering documentation, and versioned artifacts to Government-approved repositories in accordance with task order direction.
• Document pipeline dependencies, transformation logic, assumptions, known limitations, test results, release notes, and implementation status so engineering changes remain traceable and supportable.
• Support monthly ETL/ELT pipeline and documentation deliverables by providing repo commits, Word/PDF documentation, status inputs, and technical explanations as required.

ANALYTIC WORKFLOW SUPPORT, DATA QUALITY, AND AUTOMATION CHECKS

• Support updated analytic workflows by documenting processing steps, engineering logic, data dependencies, quality checks, exception handling, and audit considerations.
• Implement or support automated checks that assess completeness, consistency, validity, timeliness, transformation accuracy, and alignment with approved business rules.
• Identify data-quality issues, integration defects, missing values, mapping conflicts, and transformation anomalies that may affect readiness assessments, dashboards, or reporting products.
• Provide technical inputs to data quality assessment reports, remediation recommendations, process improvement summaries, and engineering risk discussions.

DASHBOARD, ANALYTICS, AND DATA PRODUCT ENABLEMENT

• Provide reliable engineered data products that support dashboard components, visualizations, trend analysis, forecasting, degradation assessment, stakeholder reporting, and senior leader decision support.
• Coordinate with Data Visualization / BI Developers to ensure dashboard releases are supported by current data feeds, accurate mappings, validated transformation logic, and clear engineering notes.
• Support Data Scientist / AI-ML Analyst requirements by ensuring downstream analytic products use documented, reliable, and appropriately prepared readiness data inputs.
• Incorporate Government-provided feedback into updated data products, pipeline logic, mappings, and engineering documentation within required delivery timelines.

ROLE-SPECIFIC DELIVERABLE OWNERSHIP

• Own role-level inputs for ETL/ELT pipeline updates, readiness-system integrations, data mappings, transformation logic, repository commits, engineering documentation, and technical status inputs.
• Prepare clear technical explanations, engineering summaries, implementation notes, and issue inputs for Monthly Status Reports, technical meeting minutes, action trackers, and Government briefings.
• Operate in accordance with classified-environment requirements, DD Form 254 direction, Government-approved tools, repository procedures, and non-personal services boundaries.
• Maintain focus on data engineering, integration, transformation logic, repositories, and documentation; this role does not own final Government readiness determinations, policy decisions, or analytic interpretations.

Bachelor's degree preferred in Computer Science, Data Engineering, Information Technology, Software Engineering, Systems Engineering, Data Analytics, Cybersecurity, or a STEM-related field. Equivalent senior-level DoD, IC, data engineering, software engineering, systems integration, or mission-data experience may substitute.

PROFESSIONAL CERTIFICATIONS Preferred: Security+ CE or equivalent DoD 8140/8570 foundational certification when required for access or privileged environments. Cloud, data engineering, database, DevSecOps, or data platform certifications preferred, such as AWS Certified Data Engineer, Azure Data Engineer Associate, Google Professional Data Engineer, Databricks, SnowPro, Oracle, PostgreSQL, or equivalent. Agile, SAFe, Scrum, DataOps, DevSecOps, ITIL, or Lean Six Sigma certification preferred where relevant to engineering delivery, process improvement, or technical coordination., Active TS/SCI clearance. 8+ years of data engineering, ETL/ELT development, systems integration, software engineering, database engineering, or mission-data experience, preferably in DoD, IC, Air Force, ISR, or classified environments. Experience developing, updating, and maintaining ETL/ELT pipelines, data integrations, transformation logic, data mappings, and engineering documentation for enterprise or mission systems. Strong experience with SQL, Python or similar scripting languages, data modeling, data transformation, data validation, APIs, file-based data exchange, and repository-based version control such as Git. Experience documenting source-to-target mappings, business rules, transformation logic, data dependencies, pipeline assumptions, known limitations, test results, release notes, and implementation status. Experience supporting data quality checks for completeness, consistency, timeliness, validity, transformation accuracy, lineage, and fitness for analytic or dashboard use. Experience coordinating with dashboard developers, data scientists, governance analysts, mission SMEs, and Government stakeholders to ensure engineered data products support reporting, visualization, and analytics needs. Strong written and verbal communication skills with the ability to explain technical data engineering issues, dependencies, risks, and recommendations to technical and non-technical stakeholders., Master's degree in Computer Science, Data Engineering, Information Technology, Data Analytics, Systems Engineering, Cybersecurity, or a STEM-related field. Experience supporting HAF/A2, AF A2/6, AF IC, MAJCOM, Combatant Command, OSD, Joint Staff, ODNI, or other DoD/IC headquarters-level mission environments. Familiarity with ISR readiness, readiness reporting, DRRS, DEERS, Envision, ASERT, MET/METL support, GFMB reporting, senior leader dashboards, or similar readiness/data systems. Experience with modern data platforms, cloud or hybrid environments, data lakes, warehouses, lakehouses, orchestration tools, API integration, DevSecOps pipelines, DataOps practices, and automated data-quality controls. Experience working in classified or multi-classification environments, including awareness of NIPR/SIPR/JWICS considerations, cross-domain deployment constraints, and Government-approved repository procedures. Ability to operate effectively in stakeholder-heavy, deadline-driven environments where engineering traceability, documentation quality, and data confidence are critical to mission execution.

CORE COMPETENCIES ACCOUNTABILITY & OWNERSHIP Owns engineering outputs, pipeline documentation, integration traceability, repository discipline, and technical delivery inputs for assigned readiness data products.

COMMUNICATION & COLLABORATION Communicates clearly with Government, KC, analytics, visualization, governance, readiness, and stakeholder teams to resolve engineering dependencies.

ANALYTICAL THINKING Evaluates data dependencies, transformation logic, quality findings, integration defects, and downstream impacts to improve data reliability.

QUALITY & COMPLIANCE Maintains accuracy, test evidence, version control, repository discipline, approved-format alignment, and careful handling of sensitive readiness data.

ADAPTABILITY & INITIATIVE Responds effectively to changing data sources, pipeline issues, dashboard needs, analytic requirements, Government feedback, and mission timelines.

CUSTOMER & MISSION FOCUS Connects data engineering, integration, and documentation discipline to ISR readiness visibility, analytic confidence, and A2FF decision-support value.

For more than a decade, Karthik Consulting has been a reliable and trusted advisor to our Government customers, providing independent and unbiased recommendations and solutions to mitigate risk and help solve IT issues. We bring the innovation, passion, and agility of the commercial sector to meet the unique challenges of this competitive space.