> Markdown version of [/jobs/ext/1460061-data-engineer](https://www.wearedevelopers.com/jobs/ext/1460061-data-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Data Engineer - **Company:** AI AI LLC - **Location:** San Jose, CA, United States (Remote available) - **Experience:** Expert - **Contract:** Permanent contract - **Skills:** Third Normal Form, Application Programming Interfaces (APIs), Agile Methodology, Airflow, Amazon Web Services, Amazon S3, JIRA, Microsoft Azure, BigQuery, Data Architecture, Information Engineering, Data Governance, Data Integration, Extract Transform Load (ETL), Data Transformation, Data Systems, Relational Databases, Database Queries, DevOps, Data Flow Control, Github, Python (Programming Language), NoSQL, Performance Tuning, Scrum Methodology, Systems Development Life Cycle, Role-Based Access Control, Cloudera, SQL Databases, Data Streaming, Systems Integration, Google Cloud, Cloud Platform System, Delivery Pipeline, Snowflake, Apache Spark, Cloudformation, Data Lakes, Pyspark, Git Flow, Google Cloud Functions, Data Analytics, Star Schema, Apache Kafka, Terraform, Stream Processing, Stream Analytics, Data Pipelines, Databricks - **Published:** July 27, 2026 - **Apply:** https://www.workingnomads.com/job/go/1755211/ ## About the Role Are you an experienced Data Engineering professional with a passion for building scalable, reliable, and high-performance data systems? Do you have hands-on experience designing and optimizing end-to-end real-time and batch pipelines, and developing cloud-native data architectures using modern technologies such as AWS, GCP, Azure, Databricks, and Snowflake? We are looking for a Senior Data Engineer to architect, design, and implement scalable, high-performance data solutions. The ideal candidate will be an expert in at least one major cloud data ecosystem (AWS, Azure, GCP, Snowflake, or Databricks) and possess a deep understanding of the end-to-end data lifecycle, from ingestion to business intelligence. Qualification & Skill Set Requirements Core Technical Competencies Experience: 5+ years of hands-on data engineering experience in a production environment. Languages: Strong proficiency in Python, SQL (complex queries, performance tuning), and PySpark/Apache Spark. Data Modeling: Expert knowledge of data modeling (3NF, Star, Snowflake Schema) and Lakehouse/Warehouse architectures. ETL/ELT & Orchestration: Proven experience building pipelines using tools like dbt, Airflow, Dagster, or native cloud orchestrators (Glue, Data Factory, Composer). Integrations: Experienced in integrating data from diverse sources: APIs, RDBMS/NoSQL databases, flat files, and streaming platforms (Kafka, Kinesis, Pub/Sub). Cloud Platform Expertise (Specialization-Specific) Candidates should demonstrate deep expertise in anyone of the following: Snowflake: SnowSQL, Streams, Tasks, Snowpark, and cost optimization. Databricks: Delta Lake, Unity Catalog, Delta Live Tables (DLT), and Spark optimization. GCP: BigQuery, Dataflow, Dataproc, Pub/Sub, and Cloud Functions. Azure: Synapse Analytics, Data Factory, Azure Databricks, and Stream Analytics. AWS: Redshift, S3, Lake Formation, Glue, and Lambda. Professional Practices SDLC & DevOps: Proficient in Git workflows, CI/CD pipelines (GitHub Actions, Azure DevOps, AWS CodePipeline), and IaC (Terraform/CloudFormation). Data Governance: Strong understanding of data quality, lineage, observability, security (RBAC, encryption), and compliance frameworks. Agile: Active experience in Agile/Scrum environments using Jira or Azure Boards. Mentorship: Ability to lead projects and provide technical guidance to junior/mid-level engineers. Responsibilities Architecture: Architect, design, and implement scalable, reliable data solutions and pipelines aligned with business analytics needs. Optimization: Manage and fine-tune cloud resources and workloads for maximum performance, reliability, and cost-efficiency. Data Transformation: Lead the development of ETL/ELT processes for both batch and real-time data processing. Collaboration: Partner with Product, Engineering, and Data Science teams to deliver effective, data-driven solutions. Governance & Quality: Promote and enforce best practices in data governance, security, and data quality frameworks. Mentorship: Provide technical leadership and mentorship to the team, ensuring architecture quality and best practices. Documentation: Maintain comprehensive documentation of data architectures, configurations, and workflows. Fusemachines is an Equal Opportunities Employer, committed to diversity and inclusion. All qualified applicants will receive, Are you an experienced Data Engineering professional with a passion for building scalable, reliable, and high-performance data systems? Do you have hands-on experience designing and optimizing end-to-end real-time and batch pipelines, and developing cloud-native data architectures using modern technologies such as AWS, GCP, Azure, Databricks, and Snowflake? We are looking for a Senior Data Engineer to architect, design, and implement scalable, high-performance data solutions. The ideal candidate will be an expert in at least one major cloud data ecosystem (AWS, Azure, GCP, Snowflake, or Databricks) and possess a deep understanding of the end-to-end data lifecycle, from ingestion to business intelligence. Qualification & Skill Set Requirements Core Technical Competencies Experience: 5+ years of hands-on data engineering experience in a production environment. Languages: Strong proficiency in Python, SQL (complex queries, performance tuning), and PySpark/Apache Spark. Data Modeling: Expert knowledge of data modeling (3NF, Star, Snowflake Schema) and Lakehouse/Warehouse architectures. ETL/ELT & Orchestration: Proven experience building pipelines using tools like dbt, Airflow, Dagster, or native cloud orchestrators (Glue, Data Factory, Composer). Integrations: Experienced in integrating data from diverse sources: APIs, RDBMS/NoSQL databases, flat files, and streaming platforms (Kafka, Kinesis, Pub/Sub). Cloud Platform Expertise (Specialization-Specific) Candidates should demonstrate deep expertise in anyone of the following: Snowflake: SnowSQL, Streams, Tasks, Snowpark, and cost optimization. Databricks: Delta Lake, Unity Catalog, Delta Live Tables (DLT), and Spark optimization. GCP: BigQuery, Dataflow, Dataproc, Pub/Sub, and Cloud Functions. Azure: Synapse Analytics, Data Factory, Azure Databricks, and Stream Analytics. AWS: Redshift, S3, Lake Formation, Glue, and Lambda. Professional Practices SDLC & DevOps: Proficient in Git workflows, CI/CD pipelines (GitHub Actions, Azure DevOps, AWS CodePipeline), and IaC (Terraform/CloudFormation). Data Governance: Strong understanding of data quality, lineage, observability, security (RBAC, encryption), and compliance frameworks. Agile: Active experience in Agile/Scrum environments using Jira or Azure Boards. Mentorship: Ability to lead projects and provide technical guidance to junior/mid-level engineers. Responsibilities Architecture: Architect, design, and implement scalable, reliable data solutions and pipelines aligned with business analytics needs. Optimization: Manage and fine-tune cloud resources and workloads for maximum performance, reliability, and cost-efficiency. Data Transformation: Lead the development of ETL/ELT processes for both batch and real-time data processing. Collaboration: Partner with Product, Engineering, and Data Science teams to deliver effective, data-driven solutions. Governance & Quality: Promote and enforce best practices in data governance, security, and data quality frameworks. Mentorship: Provide technical leadership and mentorship to the team, ensuring architecture quality and best practices. Documentation: Maintain comprehensive documentation of data architectures, configurations, and workflows. Fusemachines is an Equal Opportunities Employer, committed to diversity and inclusion. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, or any other characteristic protected by applicable federal, state, or local laws. ## Related Videos - [Collaboration Quantified: Lessons from Open Source Developer Networks](https://www.wearedevelopers.com/videos/1422-collaboration-quantified-lessons-from-open-source-developer-networks) - [Leveraging Real time data in FSIs](https://www.wearedevelopers.com/videos/806-leveraging-real-time-data-in-fsis) - [From DevOps to Scaled DevOps: How We’re Rebuilding Continuous Delivery as a Platform](https://www.wearedevelopers.com/videos/100018-from-devops-to-scaled-devops-how-we-re-rebuilding-continuous-delivery-as-a-platform) - [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works) - [Integrate your Cognitive Assistant with 3rd-party DBs and software](https://www.wearedevelopers.com/videos/249-integrate-your-cognitive-assistant-with-3rd-party-dbs-and-software) - [Modern Data Architectures need Software Engineering](https://www.wearedevelopers.com/videos/1030-modern-data-architectures-need-software-engineering) ## Related Articles - [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk) - [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story) - [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers) - [How to Become an AI Engineer](https://www.wearedevelopers.com/magazine/331-how-to-become-an-ai-engineer) - [Coffee with Developers - Maria Apazoglou - Making AI understandable for all in production](https://www.wearedevelopers.com/magazine/475-coffee-with-developers-maria-apazoglou-making-ai-understandable-for-all-in-production) - [Is Software Engineering Over-Saturated?](https://www.wearedevelopers.com/magazine/418-is-software-engineering-over-saturated)