> Markdown version of [/jobs/ext/1308337-big-data-engineer](https://www.wearedevelopers.com/jobs/ext/1308337-big-data-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Big Data Engineer - **Company:** Aivra Health Llc - **Location:** San Jose, CA, United States (Remote available) - **Contract:** Permanent contract - **Skills:** Airflow, Amazon Web Services, Big Data, Information Engineering, Data Integrity, Extract Transform Load (ETL), Data Warehousing, Distributed Computing Environment, Apache Hadoop, Apache Hive, Python (Programming Language), Machine Learning, Standard Sql, Unstructured Data, Data Storage Technologies, Cloud Platform System, Snowflake, Apache Spark, Git, Kubernetes, Information Technology, Apache Kafka, Data Pipelines, Docker, Databricks - **Published:** July 17, 2026 - **Apply:** https://www.dice.com/job-detail/8e5342dd-9324-426d-a0a0-1edd49fddd50 ## About the Role * Bachelor''s degree in Computer Science, Information Technology, Data Engineering, or a related field. * Strong knowledge of SQL and Python or Scala. * Experience with distributed data processing frameworks. * Understanding of ETL/ELT concepts and data warehousing. * Strong analytical, problem-solving, and communication skills. Preferred Skills * Apache Spark * Hadoop * Kafka * Hive * Scala * Python * SQL * Databricks * Snowflake * Apache Airflow * AWS * Docker * Kubernetes * Git ## Description We are seeking a highly skilled Big Data Engineer to design, develop, and maintain scalable big data solutions that process large volumes of structured and unstructured data. You will collaborate with Data Engineers, Data Scientists, and Software Engineers to build reliable data pipelines and support advanced analytics initiatives., * Design, build, and maintain scalable big data pipelines. * Develop ETL/ELT workflows for large-scale data processing. * Optimize data storage, retrieval, and processing performance. * Work with distributed computing frameworks and cloud-based data platforms. * Integrate data from multiple sources into enterprise data lakes and warehouses. * Monitor data quality and ensure data integrity. * Collaborate with cross-functional teams to support business intelligence and machine learning initiatives. * Troubleshoot and resolve data pipeline and infrastructure issues. * Maintain technical documentation and follow best engineering practices. ## Related Videos - [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works) - [Docker Compose: Rediscovered](https://www.wearedevelopers.com/videos/1978-docker-compose-rediscovered) - [How a Small Team Shrank a Microsoft Monorepo by 94%](https://www.wearedevelopers.com/videos/1236-how-a-small-team-shrank-a-microsoft-monorepo-by-94) - [Alibaba Big Data and Machine Learning Technology](https://www.wearedevelopers.com/videos/37-alibaba-big-data-and-machine-learning-technology) - [Enjoying SQL data pipelines with dbt](https://www.wearedevelopers.com/videos/823-enjoying-sql-data-pipelines-with-dbt) - [AI Model Management Life Circles: ML Ops For Generative AI Models From Research to Deployment](https://www.wearedevelopers.com/videos/1152-ai-model-management-life-circles-ml-ops-for-generative-ai-models-from-research-to-deployment) ## Related Articles - [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers) - [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know) - [How to Become an AI Engineer](https://www.wearedevelopers.com/magazine/331-how-to-become-an-ai-engineer) - [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk) - [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story) - [Coffee with Developers - Maria Apazoglou - Making AI understandable for all in production](https://www.wearedevelopers.com/magazine/475-coffee-with-developers-maria-apazoglou-making-ai-understandable-for-all-in-production)