> Markdown version of [/jobs/ext/1748100-data-engineer-aws-opensearch](https://www.wearedevelopers.com/jobs/ext/1748100-data-engineer-aws-opensearch). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Data Engineer - AWS OpenSearch - **Company:** TUPPL Technology Inc - **Location:** Fort Mill, SC, United States - **Experience:** Expert - **Contract:** Permanent contract - **Skills:** Query Performance, Amazon Web Services, Amazon Elastic Compute Cloud, Amazon S3, Cloud Engineering, Continuous Integration, Data as a Services, Extract Transform Load (ETL), Distributed Systems, Elasticsearch, Identity and Access Management, Python (Programming Language), Machine Learning, Performance Tuning, Scrum Methodology, Query Optimization, Prometheus, Standard Sql, Search Technologies, SQL Databases, Systems Integration, Snowflake, Grafana, Database Optimization, Apache Spark, Indexer, Git, Cloudformation, Pyspark, Semi-structured Data, Kubernetes, Infrastructure Automation Frameworks, AWS Glue, Data Analytics, Apache Kafka, Functional Programming, Cloudwatch, Kibana, Terraform, Splunk, Data Pipelines, Docker, Databricks - **Published:** July 22, 2026 - **Apply:** https://www.dice.com/job-detail/98772fad-c03e-4603-9c50-2ea655a4aa43 ## About the Role * 5+ years of experience as a Data Engineer. * Strong experience with AWS OpenSearch (formerly Amazon Elasticsearch Service). * Strong SQL and Python programming skills. * Experience with AWS services: * OpenSearch * S3 * Glue * Lambda * IAM * CloudWatch * EC2 * EMR * Step Functions * Kinesis (preferred) Experience building ETL/ELT pipelines. Experience with Docker and Kubernetes (preferred). Knowledge of distributed search architecture, indexing strategies, and query optimization. Experience with Git, CI/CD, and Infrastructure as Code (Terraform or CloudFormation). Familiarity with Agile/Scrum methodologies. Preferred Qualifications * Experience with Apache Spark or PySpark. * Experience with Kafka or Amazon MSK. * Experience with Snowflake, Redshift, or Databricks. * Experience working with large-scale distributed systems. * AWS Certification (Solutions Architect, Data Analytics, or Developer) is a plus. * Experience with observability tools such as Grafana, Prometheus, or Splunk. Nice to Have * Vector search and semantic search using OpenSearch. * OpenSearch Dashboards/Kibana. * Machine Learning integrations with OpenSearch. * Experience with GenAI/RAG search architectures. * Healthcare, Financial Services, or Retail domain experience. Primary Technologies: AWS OpenSearch, Python, SQL, AWS Glue, Lambda, S3, Terraform, Docker, Kubernetes, CloudWatch, Git, CI/CD, Spark/PySpark. ## Description We are seeking an experienced Data Engineer with strong expertise in AWS OpenSearch to design, develop, and maintain scalable data pipelines and search solutions. The ideal candidate will have hands-on experience with AWS data services, OpenSearch, Python, SQL, and cloud-native architectures to support analytics and real-time search capabilities., * Design, develop, and maintain scalable data pipelines using AWS services. * Build and optimize AWS OpenSearch clusters for indexing, search, and analytics. * Develop ETL/ELT pipelines using Python, SQL, and AWS services such as Glue, Lambda, and EMR. * Design and maintain OpenSearch indexes, mappings, analyzers, and query performance. * Integrate OpenSearch with upstream and downstream applications for real-time search and analytics. * Work with structured and semi-structured data from multiple data sources. * Optimize OpenSearch cluster performance, shard allocation, indexing, and query execution. * Implement Infrastructure as Code (Terraform or CloudFormation) for AWS resources. * Build monitoring and alerting using CloudWatch, Grafana, or Prometheus. * Collaborate with Data Scientists, Data Analysts, and application teams to support data and search requirements. * Implement security best practices, IAM policies, encryption, and access controls. * Troubleshoot production issues and optimize system performance. ## Related Videos - [Our journey with Spring Boot in a microservice architecture](https://www.wearedevelopers.com/videos/511-our-journey-with-spring-boot-in-a-microservice-architecture) - [Docker Compose: Rediscovered](https://www.wearedevelopers.com/videos/1978-docker-compose-rediscovered) - [How a Small Team Shrank a Microsoft Monorepo by 94%](https://www.wearedevelopers.com/videos/1236-how-a-small-team-shrank-a-microsoft-monorepo-by-94) - [Search and aggregations made easy with OpenSearch and NodeJS](https://www.wearedevelopers.com/videos/490-search-and-aggregations-made-easy-with-opensearch-and-nodejs) - [Docker build without Docker](https://www.wearedevelopers.com/videos/100114-docker-build-without-docker) - [Optimizing Discovery: PostgreSQL's Role in Transforming GetYourGuide's Search](https://www.wearedevelopers.com/videos/1647-optimizing-discovery-postgresql-s-role-in-transforming-getyourguide-s-search) ## Related Articles - [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know) - [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk) - [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers) - [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story) - [Software Engineer Salary London](https://www.wearedevelopers.com/magazine/252-software-engineer-salary-london) - [Best Companies to work for in London: Top 25 Companies in 2023](https://www.wearedevelopers.com/magazine/187-best-companies-to-work-for-in-london-top-25-companies-in-2023)