Mid-Level DevOps Engineer - HTS Data Derivation
Role details
Job location
Tech stack
Job description
We are seeking a Mid-Level DevOps Engineer to support our federal client, focused on modernizing the Harmonized Tariff Schedule of the United States (HTS). This role requires building and operating a secure, reliable pipeline to ingest, transform, validate, and deliver complex structured datasets. The senior DevOps engineer will own the infrastructure, automation, and security that make high-volume, high-accuracy data delivery possible, which includes support for LLM-assisted quality validation workflows., * Design, build, and maintain CI/CD pipelines that automate ingestion, transformation, and packaging of HTS datasets
- Design, implement, and maintain cloud-based infrastructure for data processing in AWS GovCloud.
- Work with the architect to manage the cloud infrastructure supporting data processing workloads, document storage, and LLM-based validation tooling.
- Support the OCR and PDF extraction pipeline infrastructure for digitizing historical HTS publications.
- Build monitoring, alerting, and logging capabilities to track pipeline health, data processing status, and deliverable readiness.
- Implement automated testing and validation for data pipelines.
- Coordinate with trade analysts and the project manager to ensure infrastructure supports delivery milestones as per project requirements
- Promote DevOps best practices, including infrastructure-as-code, version control, and automation.
- Document systems, architecture, and operational procedures
Requirements
Do you have experience in Validation design?, * Bachelor's or master's degree in computer science or Engineering
- 4+ years of experience in DevOps, SRE, or platform engineering roles.
- Strong experience with cloud platforms (AWS, Azure, or GCP).
- Proficiency in scripting languages such as Python, Bash, or PowerShell.
- Hands-on experience with CI/CD tools (GitHub Actions, Jenkins, Azure DevOps, GitLab CI).
- Experience with containers (Docker) and orchestration (Kubernetes).
- Knowledge of infrastructure-as-code (Terraform, Bicep, or similar).
- Hands-on experience designing, operating, and maintaining versioned data engineering and machine learning pipelines, with an emphasis on reproducibility, lineage, and controlled releases.
- Demonstrated experience implementing monitoring and evaluation frameworks for LLM-based systems, tracking output quality, operational cost, and latency., * Experience working with HTS or Trade Data pipelines
- Strong Python skills with a focus on data processing, transformation, and pipeline development
- Familiarity with workflow management tools (Nextflow, Snakemake, WDL/Cromwell).
- Understanding of Trade data formats (CSV, Excel, or JSON formats)
- Experience with big data technologies (Spark, Hadoop) or distributed computing.
- Knowledge of data storage solutions for large datasets (object storage, distributed file systems).
- Experience with HPC schedulers (SLURM, PBS, LSF).
Our estimated salary range for this position is $90,000-$130,000. This presented salary range is not a guarantee of compensation or salary. Offered salary is based on education, experience, geographic location, and possibly contractual requirements as appropriate to the role. *Salary could fall outside of this range.
Benefits & conditions
4.54.5 out of 5 stars Washington, DC Hybrid work $90,000 - $130,000 a year, Pulled from the full job description
- Paid training
- Tuition reimbursement
- Health insurance
- 401(k) matching
- Vision insurance
- 401(k) 5% Match
- Dental insurance, As a Washington Post Top Workplace award winner for the past THIRTEEN years in a row, the Top Workplaces USA for the past five years, and a recipient of the Companies As Responsive Employers (CARE) Award for the past six years, Dev Technology employees enjoy:
- Generous and flexible time-off policy
- Flexible work schedules and telework options, including remote work availability for eligible projects
- Career development opportunities including a mentorship program, technical and management training through Dev University, hands-on learning through DevLab, tuition reimbursement, and paid training opportunities
- Industry-leading benefits including a choice of two health plans that include dental and vision, flexible spending account, commuter benefits, life insurance, and more
- 401K matching with a 5% matching contribution
- Regular team and company social events including our annual party, happy hours, fitness challenges, and more
- A focus on community engagement including company wide support activities, employer match for donations, and time off for volunteer efforts
- To learn more about working at Dev Technology, visit Working At Dev Technology Group