Senior Data Engineer - SQL Pipelines

Inserso Corporation
United States
about 2 months ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
7 years minimum
Working hours
Regular working hours

Tech stack

.NET Framework Agile Methodology Microsoft Azure Big Data C Sharp (Programming Language) Cloud Database Code Review CompTIA Security+ Databases Data Architecture Extract Transform Load (ETL) Data Systems
+32 more
Data Visualization Data Warehousing Relational Databases Database Security Python (Programming Language) Microsoft SQL Server SQL Azure NIPRNet NoSQL Operational Databases Performance Tuning Query Optimization Power BI Software Engineering SQL Stored Procedures SQL Databases Database Engines Tableau (Software) Transact-SQL Data Processing Azure Data Factory Database Optimization SC Clearance Amazon Relational Database Service Pyspark Information Technology Performance Monitor Software Coding Data Inconsistencies Data Pipelines Devsecops Microservices

Job description

Inserso is seeking a hands-on Senior Data Engineer to design, build, and troubleshoot SQL-based data pipelines supporting mission-critical DevSecOps operations for the Air Force Reserve Command at Robins AFB. This role is focused on building and maintaining production data pipelines - not reporting or dashboard development. The ideal candidate has strong SQL coding skills, hands-on experience working with large datasets, and a proven track record of diagnosing and resolving complex data issues in operational environments. This position requires someone who can go beyond writing queries and take full ownership of data pipeline performance, reliability, and scalability across both NIPR/SIPR environments. Pipelines in this environment are code-first, built using SQL Server, C#/.NET microservices, and scheduling frameworks., * Build and maintain end-to-end data pipelines (ETL/ELT) that move, transform, and load large-scale datasets reliably in production environments.

  • Write and optimize complex SQL using stored procedures, CTEs, window functions, and performance tuning techniques.
  • Design, develop, and maintain SQL Server 2016+ databases including stored procedures, functions, triggers, views, and other database objects.
  • Diagnose and resolve data inconsistencies, failed pipeline jobs, and performance bottlenecks in production environments.
  • Design and implement data warehousing solutions, including incremental load strategies, staging patterns, and large-volume data handling.
  • Implement and maintain database security measures to protect sensitive data across NIPR/SIPR environments.
  • Troubleshoot and resolve database-related issues in both production and development environments.
  • Collaborate on data modeling decisions including normalized vs. denormalized schema design.
  • Participate in code reviews and ensure adherence to coding standards and best practices.
  • Mentor junior developers and provide technical guidance on SQL Server development and pipeline engineering.
  • Collaborate with application developers, system administrators, and stakeholders to deliver effective data solutions.
  • Contribute to pipeline documentation, runbooks, and data architecture documentation.
  • Support the team’s ongoing migration to Azure cloud infrastructure as the effort progresses.

Requirements

  • Must be a U.S. Citizen.
  • Bachelor’s degree in computer science or an IT-related discipline or equivalent experience.
  • Must meet DoD 8140 compliance through required certifications for elevated network privilege (e.g., CompTIA Security+). If the candidate doesn’t already possess, must be willing to obtain it prior to an agreed upon date.
  • Holds a current active DoD Secret clearance or have the ability to obtain and maintain a DoD Secret clearance.
  • 7+ years of experience in software development, with a focus on .NET and C#.
  • Deep understanding of SQL Server architecture, including database engine, storage engine, and query processor.
  • Extensive experience with T-SQL, stored procedures, functions, triggers, and views.
  • Proficiency in SQL Server 2022.
  • Strong understanding of indexing strategies, query optimization, and performance tuning.
  • Solid understanding of relational database design principles and normalization techniques.
  • Experience designing and implementing complex database schemas.
  • Proven ability to identify and resolve performance bottlenecks in SQL Server databases.
  • Experience using performance monitoring tools and techniques.
  • Experience designing and implementing ETL processes using SQL.
  • Understanding of data warehousing concepts and methodologies.
  • Strong understanding of database security principles and best practices.
  • Experience implementing and maintaining database security measures.

Preferred Skills/Experience:

  • Experience with cloud-based database solutions (e.g., Azure SQL Database, AWS RDS).
  • Experience with NoSQL databases.
  • Experience with database administration tasks.
  • Experience with Agile development methodologies.
  • SQL Server certification (e.g., Microsoft Certified: Azure Data Engineer Associate).
  • Experience with data visualization tools such as Power BI or Tableau.
  • Experience with Python/PySpark.

Physical and/or Mental Qualifications:

  • Excellent communication, interpersonal, and collaboration skills.
  • Ability to effectively communicate technical concepts to both technical and non-technical audiences.
  • Ability to work independently and as part of a team.
  • Ability to prioritize tasks and manage time effectively.
  • Ability to adapt to changing priorities and requirements.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on diversityjobs.com

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

2:37 min

Comparing traditional SQL tables versus NoSQL non-tabular databases

Stanimira Vlaeva · JS Congress

4:32 min

Harnessing Spark with Python using PySpark and Py4J

Ayon Roy · LIVE

3:09 min

Balancing data science skillings alongside systems engineering rigor

Nico Schmidt · LIVE

3:16 min

Terminology differences between relational and NoSQL databases

Tim Faulkes · LIVE

1:33 min

Recapping vital capability shifts across security and enterprise infrastructure

Sergej Reznik Sergej Reznik · Europe 2026 Virtual

3:37 min

Scaling machine learning pipelines from prototypes to petabytes

Julian Joseph · LIVE

Videos

See all

Related articles

See all