Data Engineer Journeyman

ASM
San Antonio, United States of America
5 days ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English
Experience level
Intermediate

Job location

San Antonio, United States of America

Tech stack

Amazon Web Services (AWS)
Data analysis
Azure
Google BigQuery
Cloud Engineering
Continuous Integration
Data Validation
Information Engineering
Data Governance
Data Security
Data Warehousing
Digital Assets
Distributed Computing Environment
Distributed Systems
Document-Oriented Databases
Meta-Data Management
Data Streaming
Web Application Frameworks
Google Cloud Platform
Azure
Snowflake
Spark
GIT
Containerization
Data Lake
Git Flow
Information Technology
Data Lineage
Amazon Web Services (AWS)
Data Analytics
Kafka
Terraform
Data Pipelines
Serverless Computing

Job description

  • Design, develop, and maintain batch and streaming data pipelines using frameworks such as Apache Spark, Kafka, or equivalent cloud-native services to support high-volume ingestion and processing for mission-critical workloads.

  • Build and optimize data models and schemas (including star, snowflake, and normalized designs) that support analytical, reporting, and operational use cases across the enterprise.

  • Implement data validation, profiling, and monitoring capabilities to ensure high data quality, integrity, and reliability across all stages of the data pipeline lifecycle.

  • Design, deploy, and tune scalable storage platforms such as data lakes and data warehouses, employing partitioning, indexing, and compression strategies to improve performance and cost efficiency.

  • Establish and maintain metadata management and data lineage tracking using catalog and governance tools to provide transparency, auditability, and regulatory compliance for data assets.

  • Apply secure data engineering practices, including encryption, role-based access controls, and adherence to government data standards and policies in a highly regulated environment.

  • Automate CI/CD workflows for data pipelines and related infrastructure using tools such as Git, Terraform, and containerization technologies to enable repeatable, reliable deployments.

  • Troubleshoot and resolve pipeline failures, latency issues, and performance bottlenecks in distributed computing environments, driving root cause analysis and long-term remediation.

  • Collaborate with data scientists, analysts, and business stakeholders to understand data requirements, refine transformation logic, and ensure that data products meet analytical and operational needs.

  • Document data architectures, pipeline designs, and operational procedures, and contribute to data governance activities and continuous improvement of data engineering standards and practices., Compensation ranges for ASM Research positions vary depending on multiple factors; including but not limited to, location, skill set, level of education, certifications, client requirements, contract-specific affordability, government clearance and investigation level, and years of experience. The compensation displayed for this role is a general guideline based on these factors and is unique to each role. Monetary compensation is one component of ASM's overall compensation and benefits package for employees.

Requirements

  • Bachelor's degree in Computer Science, Information Technology, Data Engineering, or a closely related field, or equivalent relevant experience.

  • Typically 2-5 years of professional experience in data engineering or a closely related field, including hands-on work with data pipelines, data models, and distributed data processing.

  • Demonstrated experience building and operating batch and/or streaming data pipelines using modern frameworks (e.g., Apache Spark, Kafka) or cloud-native equivalents.

  • Experience designing and implementing relational and analytical data models, including star, snowflake, and normalized schemas, in support of reporting and analytics.

  • Practical experience implementing data quality controls, validation, and monitoring, as well as using metadata and catalog tools to manage data assets and lineage.

  • Demonstrated ability to apply secure data engineering practices, including encryption, access control, and compliance with government or enterprise security standards.

  • Ability to obtain and maintain a SECRET-level security clearance and work in a U.S.-only staffing context, with U.S. citizenship required.

  • Willingness and ability to work effectively in a remote, distributed team environment supporting federal or enterprise IT operations.

Preferred Qualifications

  • Experience with one or more major cloud platforms (AWS, Azure, or Google Cloud) and their native data engineering services (e.g., AWS Glue, Azure Data Factory, BigQuery, or similar).

  • Familiarity with data governance frameworks and regulatory compliance requirements applicable to federal or highly regulated environments.

  • Relevant data engineering or cloud certifications (e.g., AWS Certified Data Analytics, Azure Data Engineer Associate, or equivalent).

  • Experience automating CI/CD for data pipelines and infrastructure using Terraform, Git-based workflows, and containerization/orchestration technologies., The physical requirements described in "Knowledge, Skills and Abilities" above are representative of those which must be met by an employee to successfully perform the primary functions of this job. (For example, "light office duties' or "lifting up to 50 pounds" or "some travel" required.) Reasonable accommodations may be made to enable individuals with qualifying disabilities, who are otherwise qualified, to perform the primary functions.

About the company

ASM Research, An Accenture Federal Services Company (San Antonio, TX) The Data Engineer Journeyman designs, builds, and operates scalable data pipelines and platforms that ingest, process, and store structured and unstructured data to support mission-critical use across the enterprise data environment. Leveraging modern batch and streaming frameworks, this role develops optimized data models, transformation logic, and storage solutions that enable analytics, reporting, and advanced data use cases for business and technical stakeholders. The Data Engineer Journeyman also implements data quality, lineage, and governance practices while ensuring security and compliance in a highly regulated federal data context. This position collaborates with cross-functional teams-including data scientists, analysts, and security stakeholders-to understand data requirements, refine data workflows, and continuously improve platform reliability, performance, and resilience. The engineer troubleshoots pipeline issues, documents data architecture and pipelines, and contributes to ongoing modernization and automation of data engineering processes and tooling across the client environment.

Apply for this position