AWS Data Automation Engineer

The AWS Data Automation Engineer is responsible for designing, developing, testing, troubleshooting, and maintaining software-intensive data solutions and automated data pipelines. This role focuses on building production-grade data engineering solutions using Python, SQL, AWS services, Apache Spark, and data ingestion technologies. The position also requires hands-on experience integrating Generative AI and large language model (LLM) platforms into Python-based workflows. The successful candidate works independently on moderately complex assignments and collaborates with technical teams and project stakeholders to develop reliable, scalable data solutions., * Design, develop, test, troubleshoot, and debug software and data engineering solutions.

• Develop and maintain production ETL/ELT processes and automated data pipelines.
• Build and maintain AWS-based data pipelines and automation using services such as S3, Glue, Lambda, EMR, Step Functions, and AWS database services.
• Develop data engineering solutions using Python and SQL.
• Build and optimize data processing workflows using Apache Spark.
• Implement data ingestion and streaming solutions using technologies such as Kafka or Flume.
• Integrate REST APIs into Python-based data workflows.
• Integrate Generative AI and LLM platforms, such as Amazon Bedrock, Azure OpenAI, or open-source models, into Python applications and workflows.
• Apply software development standards, processes, procedures, and tools throughout the software development life cycle.
• Analyze software and data requirements and assess compatibility with supporting infrastructure and platforms.
• Troubleshoot technical issues and develop solutions using established engineering practices and collaboration with technical teams.
• Support CI/CD processes using tools such as GitHub, Azure DevOps, or Jenkins.
• Document technical solutions, practices, and procedures and communicate them effectively to project stakeholders and technical resources.
• Assist other technical staff with tasks and assignments as needed.

• 5+ years of experience in data engineering, data automation, or a related field.
• U.S. citizenship.
• Ability to obtain a Federal Public Trust clearance.
• Bachelor’s degree in Computer Science or a related field.
• Strong hands-on Python and SQL experience.
• Significant hands-on experience developing AWS data pipelines and automation.
• Experience with multiple AWS services, including S3, Glue, Lambda, EMR, Step Functions, and AWS database services.
• Strong Apache Spark experience.
• Experience with at least one ingestion or streaming technology, such as Kafka or Flume.
• Hands-on experience developing production ETL/ELT processes and data pipelines.
• Practical experience integrating an LLM or Generative AI platform into a Python-based workflow.
• Experience integrating REST APIs into Python-based workflows.
• CI/CD experience with GitHub, Azure DevOps, or Jenkins.
• Experience with Jira.
• Ability to work independently on moderately complex projects and assignments.
• Strong troubleshooting and problem-solving skills.
• Ability to communicate technical solutions, practices, and procedures effectively.

Preferred Experience

• AWS and Azure multi-cloud experience.
• Experience with Retrieval-Augmented Generation (RAG).
• Experience with embeddings and vector search.
• Experience with Solr or OpenSearch.
• Experience with Docker or Kubernetes.
• Experience with Terraform.

Education

• Bachelor’s degree in Computer Science or a related field., We are committed to providing equal employment opportunities to all employees and applicants without regard to race, religion, color sex, national origin, citizenship status, age, sexual orientation, gender identity, marital status, uniform service member status, genetic information, disability, or any other protected status, in accordance with all applicable federal, state, and local laws. This practice extends to all aspects of our employment practices, including but not limited to, recruiting, hiring, firing, promoting, transferring, compensation, benefits, training, leaves of absence, and other terms and conditions of employment.

We offer a comprehensive benefits package to our employees, which includes:

• Medical Insurance
• Vision & Dental Insurance
• Life Insurance
• Matching 401(k)
• Commuter Benefits
• Employee Discounts & Rewards
• Payroll Payment Options

Equiliem believes in empowering success. It’s our job to cultivate relationships that connect people and employers in a way that is inclusive, intelligent, and allows both to thrive.

Across the U.S., leading companies in healthcare, government, engineering, manufacturing, professional services, and energy rely on us for their workforce solutions. Our recruiting and HR services include contract and direct hire staffing, Payrolling/EOR, Independent Contractor Compliance, and Managed Services.

For almost 30 years, we’ve helped shape our industry. Today, we continue to research, ask questions, and continuously enhance the candidate journey and client experience.