> Markdown version of [/jobs/ext/3095426-data-engineer](https://www.wearedevelopers.com/jobs/ext/3095426-data-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Data Engineer - **Company:** Horizontal Talent - **Location:** Brooklyn Park, MN, United States - **Salary:** $76,960.0 - $147,680.0 - **Contract:** Permanent contract - **Skills:** Java (Programming Language), Apache HTTP Server, Application Frameworks, Automation of Tests, Big Data, BigQuery, Code Review, Continuous Integration, Information Engineering, Extract Transform Load (ETL), Database Development, Database Queries, DevOps, Distributed Computing Environment, Apache Hadoop, Apache Hive, Python (Programming Language), Meta-Data Management, Operational Databases, Query Optimization, Cloudera, Simple Data Format, Software Engineering, Data Streaming, Parquet, Data Logging, Google Cloud, Cloud Platform System, Apache Spark, Git, Data Lakes, Infrastructure Automation Frameworks, Deployment Automation, Apache Kafka, Data Management, Terraform, Looker Analytics, Software Version Control, Data Pipelines - **Published:** September 26, 2026 - **Apply:** https://www.jofdav.com/jobs/59871039-data-engineer ## About the Role * Strong experience building production data pipelines in a data engineering environment. * Hands-on ETL/ELT development experience. * Practical experience with Google Cloud Platform. * Solid BigQuery skills, including SQL development and query optimization. * Experience working with Apache Spark and distributed data processing. * Experience with GCP Dataproc. * Exposure to Hadoop and/or Kafka. * Strong SQL skills and the ability to work with large datasets. * Proficiency in Python and/or Java/Scala. * Understanding of data modeling, partitioning, and common data/file formats. * Experience supporting production systems and resolving issues quickly and effectively. * Familiarity with DevOps practices, Git, automated deployments, and CI/CD workflows. Preferred Skills * Experience with Looker and/or LookML. * Knowledge of GCS, BigLake, Hive, Apache Iceberg, and Parquet. * Exposure to Terraform or other Infrastructure-as-Code tools. * Experience building Kafka-based streaming solutions. * Background in migrating workloads from on-premises Hadoop/Hive environments to GCP. * Experience supporting data lake or platform modernization initiatives. * Familiarity with data quality, governance, lineage, and metadata management. Horizontal is committed to fostering an inclusive, respectful, and equitable environment where people from all backgrounds can thrive. We value diverse perspectives and encourage candidates to apply even if they do not meet every preferred qualification. ## Description We're looking for a skilled Data Engineer to help design and deliver scalable data solutions that power analytics and business decision-making. This hybrid opportunity offers the chance to work with modern cloud data platforms, large-scale processing tools, and a collaborative team focused on building reliable, high-performing pipelines. Responsibilities * Design, build, test, and maintain scalable ETL and ELT pipelines for large and complex datasets. * Develop distributed data processing solutions using Apache Spark and Google Cloud Platform services. * Create and support analytical data assets in BigQuery, with a focus on performance, cost efficiency, and reliability. * Build batch and streaming data workflows using technologies such as Spark, Hadoop, and Kafka. * Develop ingestion and transformation processes across source systems, data lakes, and analytics environments. * Troubleshoot production data issues, identify root causes, and implement durable fixes. * Put data quality, monitoring, logging, and alerting controls in place to support stable operations. * Partner with architects, engineers, and business stakeholders to turn requirements into production-ready solutions. * Contribute to code reviews, reusable frameworks, and engineering best practices. * Apply software engineering and DevOps practices, including version control, automated testing, CI/CD, and deployment automation. ## Related Videos - [Parquet, Delta, Iceberg & Ducklake - An introduction for developers](https://www.wearedevelopers.com/videos/100075-parquet-delta-iceberg-ducklake-an-introduction-for-developers) - [Modern Data Architectures need Software Engineering](https://www.wearedevelopers.com/videos/1030-modern-data-architectures-need-software-engineering) - [From DevOps to Scaled DevOps: How We’re Rebuilding Continuous Delivery as a Platform](https://www.wearedevelopers.com/videos/100018-from-devops-to-scaled-devops-how-we-re-rebuilding-continuous-delivery-as-a-platform) - [How a Small Team Shrank a Microsoft Monorepo by 94%](https://www.wearedevelopers.com/videos/1236-how-a-small-team-shrank-a-microsoft-monorepo-by-94) - [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works) - [OLAP for AI Applications and why you should care](https://www.wearedevelopers.com/videos/100212-olap-for-ai-applications-and-why-you-should-care) ## Related Articles - [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story) - [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know) - [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk) - [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers) - [Got AI ideas but no money? Here are 10 free ways to level up your AI skills with Google Cloud](https://www.wearedevelopers.com/magazine/600-got-ai-ideas-but-no-money-here-are-10-free-ways-to-level-up-your-ai-skills-with-google-cloud) - [How We Built a Worry-Free System That Runs for 10+ Years – And What We’d Do Again](https://www.wearedevelopers.com/magazine/751-how-we-built-a-worry-free-system-that-runs-for-10-years-and-what-we-d-do-again)