> Markdown version of [/jobs/ext/3037542-data-automation-engineer](https://www.wearedevelopers.com/jobs/ext/3037542-data-automation-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Data Automation Engineer - **Company:** Talascend LLC - **Location:** United States (Remote available) - **Experience:** Expert - **Salary:** $114,400.0 - $128,960.0 - **Contract:** Permanent contract - **Skills:** Artificial Intelligence, Amazon Web Services, Amazon S3, Microsoft Azure, Information Engineering, Data Integration, Github, Python (Programming Language), Machine Learning, Open Source Technology, Operational Databases, PCI Data Security Standards, Performance Tuning, Search Technologies, Apache Solr, SQL Databases, Data Streaming, Retrieval-Augmented Generation, Large Language Models, Apache Spark, Software Troubleshooting, Multi-Cloud, Generative AI, Cloudformation, Apache Flume, Kubernetes, Infrastructure Automation Frameworks, Information Technology, Collibra, AWS Fargate, Apache Kafka, Restful APIs, Terraform, Data Pipelines, Jenkins, Databricks - **Published:** September 23, 2026 - **Apply:** https://www.talascend.com/portal/jobseekers/jobs/136317/application ## About the Role * Bachelor's degree in Computer Science or a related field * 5+ years of experience in data engineering, data automation, or related discipline * Ability to design, develop, test, and troubleshoot Python- and SQL-based data pipelines in AWS environments, including Azure integrations * Strong hands-on experience with Apache Spark and streaming/integration technologies such as Kafka or Flume * Experience with AWS data and integration services including S3, Glue, Lambda, EMR, and database services * Practical experience with LLM platforms or models such as Amazon Bedrock, Azure OpenAI, or open-source models in Python workflows * Experience integrating REST APIs and external services into data pipelines * Proficiency with source-control and CI/CD platforms like GitHub, Azure DevOps, or Jenkins * Strong troubleshooting, performance optimization, and support skills for production data platforms * U.S. citizenship and ability to obtain Federal Public Trust clearance, * Relevant certifications such as AWS Certified Data Engineer - Associate, AWS Certified Machine Learning - Specialty, Azure AI Engineer Associate, or Databricks Certified Data Engineer * Familiarity with retrieval-augmented generation pipelines, embeddings, and vector-search technologies such as Solr or OpenSearch * Experience with multi-cloud data integration (AWS and Azure) * Operational experience with Generative AI workflows, including monitoring and lifecycle management * Knowledge of data governance tools and infrastructure-as-code tools like Terraform or CloudFormation * Experience with compliance frameworks such as FedRAMP, PCI-DSS, or HIPAA ## Description This role involves designing and implementing data automation solutions primarily on AWS, with integration to Azure services and Generative AI capabilities. The engineer will build scalable data pipelines and automation workflows to support analytics, reporting, and customer engagement platforms in a remote setting., * Design and implement scalable data automation workflows using AWS services, with integration to selected Azure data platforms where required * Develop ETL/ELT processes to ingest, transform, and move data across various cloud data sources such as Amazon DynamoDB, SQL Server on AWS, and Azure SQL * Design, develop, and support batch and near-real-time ingestion pipelines using Apache Spark, Kafka, Flume, and integrate with existing platforms such as Apache Solr * Evaluate and apply Generative AI services and frameworks, including Amazon Bedrock, Azure OpenAI, Hugging Face, and LangChain, to prototype and evaluate AI-assisted capabilities * Develop scalable data-processing solutions using Amazon EMR and containerized environments like AWS Fargate or Kubernetes * Integrate customer-interaction data into analytical data stores for reporting and analytics * Implement data solutions following security and compliance standards, including IAM, encryption, VPC, and role-based access control * Support Agile DevOps processes through sprint-based development of pipeline and AI features * Troubleshoot, monitor, and optimize data pipelines and workflows ensuring SLAs are met ## Related Videos - [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works) - [The Road to MLOps: How Verivox Transitioned to AWS](https://www.wearedevelopers.com/videos/1050-the-road-to-mlops-how-verivox-transitioned-to-aws) - [Innovating Developer Tools with AI: Insights from GitHub Next](https://www.wearedevelopers.com/videos/1268-innovating-developer-tools-with-ai-insights-from-github-next) - [Enjoying SQL data pipelines with dbt](https://www.wearedevelopers.com/videos/823-enjoying-sql-data-pipelines-with-dbt) - [Our GitOps approach for deploying an Identity Provider and an API Gateway in a SaaS company](https://www.wearedevelopers.com/videos/776-our-gitops-approach-for-deploying-an-identity-provider-and-an-api-gateway-in-a-saas-company) - [Bringing AI Model Testing and Prompt Management to Your Codebase with GitHub Models](https://www.wearedevelopers.com/videos/1536-bringing-ai-model-testing-and-prompt-management-to-your-codebase-with-github-models) ## Related Articles - [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers) - [How to Become an AI Engineer](https://www.wearedevelopers.com/magazine/331-how-to-become-an-ai-engineer) - [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk) - [Coffee with Developers - Maria Apazoglou - Making AI understandable for all in production](https://www.wearedevelopers.com/magazine/475-coffee-with-developers-maria-apazoglou-making-ai-understandable-for-all-in-production) - [MLOps And AI Driven Development](https://www.wearedevelopers.com/magazine/82-mlops-and-ai-driven-development) - [Navigating the AI Shift](https://www.wearedevelopers.com/magazine/629-navigating-the-ai-shift)