AWS Cloud Data Engineer
Guidehouse Inc.
San Antonio, United States of America
yesterday
Role details
Contract type
Permanent contract Employment type
Full-time (> 32 hours) Working hours
Regular working hours Languages
English Experience level
IntermediateJob location
San Antonio, United States of America
Tech stack
Query Performance
Java
Airflow
Amazon Web Services (AWS)
Amazon Web Services (AWS)
Data analysis
Big Data
Databases
Data as a Services
Information Engineering
Data Governance
ETL
Data Migration
Data Retention
Data Security
Data Systems
Data Visualization
Data Warehousing
Relational Databases
Distributed Computing Environment
Amazon DynamoDB
JSON
Python
PostgreSQL
Meta-Data Management
NoSQL
Oracle Applications
Performance Tuning
Power BI
SQL Databases
Data Streaming
Tableau
Workflow Management Systems
Parquet
Data Processing
Data Storage Technologies
Spark
Reliability of Systems
Electronic Medical Records
GIT
Cloudformation
Data Lake
Kubernetes
Infrastructure Automation Frameworks
Information Technology
Avro
Amazon Web Services (AWS)
Amazon Web Services (AWS)
Terraform
Software Version Control
Data Pipelines
Docker
Job description
- We are seeking an experienced AWS Data Engineer to design, build, and maintain robust data pipelines, and data processing solutions in the AWS cloud environment.
- This role will work closely with our AWS Cloud DBA to create end-to-end data solutions to migrate data from legacy application to AWS cloud platform ensuring optimal performance and reliability.
- The ideal candidate has hands-on experience with AWS data services, modern data architecture patterns, and can collaborate with database administrators, data scientists, and business stakeholders to deliver scalable data solutions.
- Design and implement scalable data pipelines using AWS services including AWS Glue, Step Functions, Lambda, and Kinesis. Build ETL/ELT processes to ingest, transform, and load data from various sources into data warehouses and data lakes.
- Architect and maintain data lakes using S3, implement data cataloging with AWS Glue Catalog, and optimize data storage formats (Parquet, Delta, etc.). Design data warehouse solutions using Redshift and integrate with existing RDS/Aurora databases managed by the DBA team.
- Develop real-time and batch data processing solutions using Kinesis Data Streams, Kinesis Analytics, EMR, and AWS Batch.
- Create and maintain data models, schemas, and documentation. Work with the DBA team to optimize data access patterns and query performance across relational and analytical databases.
- Build automated data quality checks, monitoring, and alerting systems. Implement data governance policies and ensure compliance with data retention, privacy, and security requirements.
Requirements
- US Citizenship or Green Card is required.
- Must be able to OBTAIN and MAINTAIN a Federal or DoD "PUBLIC TRUST"; candidates must obtain approved adjudication of their PUBLIC TRUST prior to onboarding with Guidehouse. Candidates with an ACTIVE PUBLIC TRUST or SUITABILITY are preferred.
- Bachelor's degree in computer science, Data Engineering, or related field. Additional Four (4) experience can be used in lieu of degree.
- Minimum SIX (6) years of experience in data engineering with at least 3+ years working in AWS cloud environments
- Strong expertise in AWS data services including S3, Glue, DMS, Athena, Redshift, EMR, Kinesis, and Lambda
- Proficiency in programming languages including Python, Scala, or Java for data processing and pipeline development
- Experience with SQL and working knowledge of both relational databases (PostgreSQL, Oracle) and NoSQL systems (DynamoDB, DocumentDB)
- Understanding of data modeling concepts for both transactional and analytical workloads
- Experience with Infrastructure as Code tools (Terraform, CloudFormation, CDK) and CI/CD pipelines for data engineering workflows
- Strong analytical and problem-solving skills with attention to data quality and system reliability
- Proven ability to work collaboratively with database administrators, data scientists, and business stakeholders
What Would Be Nice To Have:
- AWS Certified Data Engineer - Associate certification (Highly desirable)
- AWS Certified Solutions Architect or other relevant AWS certifications
- Familiarity with big data frameworks such as Apache Spark, Apache Airflow, or AWS-native orchestration tools
- Knowledge of data formats (JSON, Avro, Parquet, ORC) and compression techniques for optimal storage and processing
- Familiarity with version control systems (Git) and collaborative development practices
- Knowledge of container orchestration (Docker, Kubernetes, ECS, EKS)
- Experience with data visualization tools (QuickSight, Tableau, PowerBI)
- Understanding of data privacy regulations (GDPR, CCPA) and compliance frameworks
- Experience with performance tuning and optimization of distributed data processing systems
Benefits & conditions
Guidehouse offers a comprehensive, total rewards package that includes competitive compensation and a flexible benefits package that reflects our commitment to creating a diverse and supportive workplace.
Benefits include:
- Medical, Rx, Dental & Vision Insurance
- Personal and Family Sick Time & Company Paid Holidays
- Parental Leave
- 401(k) Retirement Plan
- Group Term Life and Travel Assistance
- Voluntary Life and AD&D Insurance
- Health Savings Account, Health Care & Dependent Care Flexible Spending Accounts
- Transit and Parking Commuter Benefits
- Short-Term & Long-Term Disability
- Tuition Reimbursement, Personal Development, Certifications & Learning Opportunities
- Employee Referral Program
- Corporate Sponsored Events & Community Outreach
- Care.com annual membership
- Employee Assistance Program
- Supplemental Benefits via Corestream (Critical Care, Hospital Indemnity, Accident Insurance, Legal Assistance and ID theft protection, etc.)
- Position may be eligible for a discretionary variable incentive bonus
About Guidehouse
Guidehouse is an Equal Opportunity Employer-Protected Veterans, Individuals with Disabilities or any other basis protected by law, ordinance, or regulation.
Guidehouse will consider for employment qualified applicants with criminal histories in a manner consistent with the requirements of applicable law or ordinance including the Fair Chance Ordinance of Los Angeles and San Francisco.