Senior Data Engineer- US Citizen
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Tech stack
+2 more
Job description
Design, develop, and maintain scalable data pipelines using Apache Spark (PySpark and/or Scala) Build and optimize data workflows on Databricks, including Delta Lake, notebooks, and scheduled jobs Ingest, transform, and curate large-scale structured and semi-structured datasets Perform performance tuning and cost optimization of Spark workloads and Databricks clusters Implement data quality checks, monitoring, and error handling Collaborate with analytics and business stakeholders to deliver well-modeled, analytics-ready data Support batch processing and, where applicable, streaming data pipelines Follow best practices for testing, documentation, security, and version control
Requirements
5+ years of experience in Data Engineering or related roles Strong hands-on experience with Apache Spark (PySpark or Scala) Proven experience working in Databricks environments Strong SQL skills and experience with relational and analytical databases Experience building and maintaining ETL/ELT pipelines at scale Familiarity with modern data lake architectures (Delta Lake preferred) Experience with Git-based version control Must be a US Citizen Flexible work from home options available.
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Apply on www.wayup.comGood distractions
Talks and stories from around this role — technically off-topic, practically not.
Moments
Explore playlistsVideos
See allRelated articles
See all
Highest Paying Tech Companies for Developers
Data Engineer Salary UK
Top Big Data Technologies That You Need to Know
Making Data Warehouses Fast: A Developer’s Story