Sr. Data Engineer
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Tech stack
+15 more
Job description
A client is seeking a Senior Data Engineer to join their growing Data Engineering team! This person will will play a key role in shaping both
customer-facing and business-facing data products that align with their mission. Your
technical expertise and analytical acumen will contribute to designing and building
extensive data sets that impact thousands of internal users and millions of members.
Join a world-class data engineering team dedicated to advancing your skills and career
in data engineering and beyond.
Essential Functions:
-Collaborate with engineers, product managers, and data scientists to
understand data needs and develop end-to-end data pipelines, solutions, and
foundational data sets
-Design and own the data architecture for large-scale projects, making informed
decisions about design and operational trade-offs
-Build, launch, and optimize sophisticated data pipelines, data models, and
visualizations that support diverse use cases across multiple products or
domains
-Define and manage Service Level Agreements (SLAs) for all data sets within
areas of ownership
-Implement data security models based on privacy requirements, ensure
compliance with safeguards, address data quality issues, and evolve data
governance processes
-Solve complex data integration challenges using optimal ETL/ELT patterns,
frameworks, and query techniques for both structured and unstructured data
sources
-Maintain and enhance existing production processes by optimizing complex
Requirements
- Bachelor’s degree in Computer Science, Computer Engineering, or a relevant
technical field; a master’s degree is preferred
- 5+ years of experience in data engineering, database engineering, business
intelligence, data warehousing, and ETL tools, working with large data sets in
the cloud
- 5+ years of experience with Python, and experience building scalable Big Data
solutions and ETL ecosystems
- Proficiency in SQL, ETL/ELT, and data modeling, with extensive experience in
Snowflake and dbt
- Hands-on experience with RDBMS such as MySQL, MS SQL Server, and
Postgres
- Familiarity with integration tools like Airflow and Automic, along with a working
knowledge of CI/CD pipelines
- Ability to deliver high standards of code quality, system reliability, and
performance
- Experience with Spark and PySpark to handle large-scale data processing and
enhance data pipeline efficiency
- Strong proficiency in Terraform is a must-have - Masters degree
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Apply on dejobs.orgGood distractions
Talks and stories from around this role — technically off-topic, practically not.
Moments
Explore playlistsVideos
See allRelated articles
See all
Highest Paying Tech Companies for Developers
Making Data Warehouses Fast: A Developer’s Story
Top Big Data Technologies That You Need to Know
Top-Paying Tech Jobs (with Salaries)