Data Engineering

The Sponsor requires Data Engineering support to evaluate, optimize, and implement robust data infrastructure that enables reliable, accessible, and scalable data delivery across the organization. The Contractor will work collaboratively with data consumers, technical teams, leadership, and stakeholders to assess current data pipelines, identify gaps in data accessibility and reliability, and architect solutions that establish trusted data foundations. Work involves applying engineering best practices to implement proper data modeling and integration patterns, ensuring data quality and observability throughout pipelines, and creating maintainable infrastructure that supports analytics, reporting, and operational use cases. The Sponsor’s data landscape includes enterprise operational systems such as ServiceNow, network management platforms (NetIM), and network modeling tools (Forward Networks). The Data Engineering support must be adept at extracting data from these systems via APIs (application Programming Interface), exports, and vendor-specific interfaces, often with limited documentation or non-standard data structures, and transforming this operational data into accessible, integrated datasets.

• Demonstrated experience designing, building, and maintaining production data pipelines using orchestration tools such as Apache Airflow or similar.
• Demonstrated experience with SQL skills including complex queries, optimization, and performance tuning across multiple database platforms.
• Demonstrated experience integrating data from Sponsor SaaS platforms and operational systems via APIs, including handling authentication, pagination, and rate limiting.
• Demonstrated experience working with semi-structured data (JSON and XML) from API responses and transforming into structured datasets.
• Demonstrated experience with developing robust API integrations with proper error handling and retry logic.
• Demonstrated experience working with systems that have limited documentation or vendor-specific data models.
• Demonstrated experience with dimensional modeling and data warehouse design patterns.
• Demonstrated proficiency in Python for data engineering including working with data processing libraries.
• Demonstrated experience with cloud data platforms such as AWS, Azure, or GCP, including data services and infrastructure.
• Demonstrated experience implementing ETL/ELT processes from diverse data sources
• Demonstrated experience with version control (Git) and software engineering best practices.
• Demonstrated experience with strong problem-solving and troubleshooting skills for complex data pipeline issues.
• Demonstrated experience with strong problem-solving and troubleshooting skills for complex data pipeline issues.
• Demonstrated experience implementing data quality checks and validation frameworks
• Demonstrated experience translating business requirements into technical data solutions
• Demonstrated experience in having a proven track record of delivering reliable, scalable data infrastructure, * Demonstrated experience with ServiceNow APIs, data models, and integration patterns.
• Demonstrated experience with network management or IT operations systems data extraction.
• Demonstrated experience with Forward Networks, NetIM, SolarWinds, or similar network management platforms.
• Demonstrated experience and knowledge of ITSM (Information Technology Service Management), ITOM (Information Technology Operations Management), and CMDB (Configuration Management Database) data structures and relationships.
• Demonstrated experience with API gateway platforms and API management tools.
• Demonstrated experience with Apache Spark, particularly PySpark, for distributed data processing.
• Demonstrated experience with DBT (data build tool) for transformation workflows.
• Demonstrated experience with infrastructure-as-code tools such as Terraform or CloudFormation.
• Demonstrated experience implementing CI/CD (Continuous Integration/Continuous Delivery) pipelines for data engineering code.
• Demonstrated experience and knowledge of streaming data technologies such as Kafka, Kinesis, or similar platforms.
• Demonstrated experience with data quality platforms such as Great Expectations, Soda, or Monte Carlo.
• Demonstrated experience implementing data observability and monitoring solutions.
• Demonstrated experience and knowledge of Data Vault or other advanced modeling methodologies.
• Demonstrated experience with containerization (Docker) and orchestration (Kubernetes) for data workloads.
• Demonstrated experience with reverse ETL and operational analytics patterns.
• Demonstrated experience with data governance platforms and metadata management tools.
• Demonstrated experience with multiple cloud platforms and multi-cloud architectures.
• Demonstrated experience mentoring or leading data engineering initiatives., * The successful candidate must have an active U.S. Government Top Secret Security Clearance with a Full Scope Polygraph.

At J5, we’re a team of innovators protecting organizations from evolving cyber threats. With 18+ years of success in government and commercial sectors, we offer meaningful opportunities to grow your career.

Enjoy comprehensive benefits, including:

• Medical, dental and vision
• Retirement plans with 6% company match
• Paid Time Off
• Life insurance
• Short and long term disability
• Flexible Spending Accounts
• Professional development
• Reimbursement of educational expenses
• Tuition reimbursement
• Team building outings
• Referral bonus
• Business development bonus, * Clearance Verification: This position requires successful verification of the stated security clearance to meet federal government customer requirements. You will be asked to provide clearance verification information prior to an offer of employment.

Travel:

• This position is expected to be onsite. The position will be located within the Washington Metropolitan Area (WMA). Local travel/POV will be on an as needed basis, within the local place of performance.

Join J5 Consulting and Grow Your Cybersecurity Career

At J5, we’re a team of innovators protecting organizations from evolving cyber threats. With 18+ years of success in government and commercial sectors, we offer meaningful opportunities to grow your career.

Enjoy comprehensive benefits, including:

• 100% employer-paid health coverage
• a 6% 401(k) match
• PTO
• tuition reimbursement
• bonuses
• professional development, and more., Invitation for Job Applicants to Self-Identify as a U.S. Veteran
• A “disabled veteran” is one of the following:
• a veteran of the U.S. military, ground, naval or air service who is entitled to compensation (or who but for the receipt of military retired pay would be entitled to compensation) under laws administered by the Secretary of Veterans Affairs; or
• a person who was discharged or released from active duty because of a service-connected disability.
• A “recently separated veteran” means any veteran during the three-year period beginning on the date of such veteran’s discharge or release from active duty in the U.S. military, ground, naval, or air service.
• An “active duty wartime or campaign badge veteran” means a veteran who served on active duty in the U.S. military, ground, naval or air service during a war, or in a campaign or expedition for which a campaign badge has been authorized under the laws administered by the Department of Defense.
• An “Armed forces service medal veteran” means a veteran who, while serving on active duty in the U.S. military, ground, naval or air service, participated in a United States military operation for which an Armed Forces service medal was awarded pursuant to Executive Order 12985.

J5 Consulting is a Maryland based company established in 2006 to provide computing and consulting services for government and commercial entities. Our services improve Information System networking performance and compliance and protect electronic assets from loss and compromise. We welcome your application to receive consideration for the following position.