Data Engineer

Insight Global is seeking a Data Engineer to support a Joint Staff J7 program in Suffolk, VA. This team supports military training efforts by enabling data-driven solutions that help prepare forces to respond to global operations and crisis scenarios., Designing, developing, testing, and operating ETL/ELT data pipelines using tools such as Apache Spark Ensuring data pipelines are reliable, performant, and cost-effective Defining and enforcing data quality checks to maintain accuracy and integrity of data Diagnosing and resolving issues across data ingestion, transformation, and query processes Documenting workflows, processes, and data definitions to support knowledge sharing across teams Maintaining up-to-date documentation in Confluence, including data dictionaries Participating in data cataloging efforts and ensuring adherence to security and compliance requirements Collaborating with functional business units to understand requirements, develop solutions, and present findings to support decision-making

2+ years of experience with a Bachelor's degree in a related field, OR 0 years with a Master's, OR 6+ years of relevant experience with a High School diploma/equivalent

• Experience developing and working with data pipelines, including ETL/ELT processes
• Hands-on experience with tools such as Apache Spark, Airflow, and Python for data processing and analytics
• Familiarity with data visualization and analytics tools such as Superset, Qlik, or similar platforms
• Experience with version control and CI/CD pipelines (Git workflows)
• Working knowledge of agile tools such as JIRA or similar platforms
• Strong written and verbal communication skills
• Ability to work both independently and within a team environment
• Strong organizational skills with a high attention to detail
• Self-motivated with the ability to operate with minimal direction

Nice to Have Skills & Experience

Experience configuring and using Apache Superset for connecting to data sources and building dashboards Familiarity with Talend and Qlik data/analytics tools Experience working with Apache Spark and Airflow in a development environment Knowledge of Git workflows and CI/CD pipelines Experience developing data analytics and processing pipeline applications using Python Working knowledge of JIRA or similar Agile tools

$45/hr to $50/hr.

Exact compensation may vary based on several factors, including skills, experience, and education.

Benefit packages for this role will start on the 31st day of employment and include medical, dental, and vision insurance, as well as HSA, FSA, and DCFSA account options, and 401k retirement account access with employer matching. Employees in this role are also entitled to paid sick leave and/or other paid time off as provided by applicable law., Benefit packages for this role will start on the 1st day of employment and include medical, dental, and vision insurance, as well as HSA, FSA, and DCFSA account options, and 401k retirement account access with employer matching. Employees in this role are also entitled to paid sick leave and/or other paid time off as provided by applicable law.