Senior Engineer - Data Engineering

McGraw-Hill
Columbus, OH, United States
6 days ago
Apply on jobs.localjobnetwork.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
1 year minimum
Working hours
Regular working hours

Tech stack

Application Programming Interfaces (APIs) Amazon Web Services Amazon S3 Confluence JIRA Big Data Cloud Database Information Engineering Data Governance Data Infrastructure Extract Transform Load (ETL) Data Stores
+31 more
Data Warehousing Dimensional Modeling Fault Tolerance Github Apache Hive Python (Programming Language) PostgreSQL Operational Databases Performance Tuning Scala (Programming Language) SQL Databases Data Streaming Sql Optimization Great Expectations (Foster Youth College-readiness and Support Program) Apache Spark Backend Git Amazon Relational Database Service Data Lakes Pyspark Kubernetes Information Technology Slack AWS Data Analytics Apache Kafka Restful APIs Terraform Data Pipelines Sql Tuning Docker Databricks

Job description

McGraw Hill is a learning science company that delivers personalized learning experiences to help students, parents, educators, and professionals drive results. We are hiring a Senior Engineer to join our Insights and Personalization Engineering team and build reporting and personalization features at scale on our Open Learning platform. This role focuses on data engineering in Databricks for Symphony, the platform behind teacher- and administrator-facing reports for products such as PRoPL, OpenLearning, and MHPlus. How are you creating an impact?

You will own the data pipelines and analytics models in our Databricks lakehouse that power reports used by millions of users, from ingestion through to the serving layer consumed by our reporting APIs and UIs. Working closely with backend, UI, product, and data platform teams, you will help shape how McGraw Hill delivers insights to educators. What will you be doing?

  • Translate business requirements into technical specifications and solution designs, partnering with product and engineering leaders
  • Build and maintain scalable batch and incremental data pipelines using PySpark, Spark SQL, Delta Lake, and Databricks Workflows
  • Design reporting data models using dimensional modeling and medallion (bronze/silver/gold) architecture
  • Build and optimize the SQL serving layer in Unity Catalog, including views, materialized views, and table-valued functions
  • Tune Spark and SQL performance and manage compute cost
  • Own data quality, observability, and reliability through automation, testing, and monitoring
  • Apply data governance and access controls through Unity Catalog
  • Lead design reviews and mentor engineers on data engineering best practices

Our stack includes

  • Languages: Go (APIs/services), Python/PySpark, Spark SQL, Scala (data pipelines)
  • Databricks: Delta Lake, Unity Catalog, PySpark/Spark SQL, Databricks SQL warehouses, Workflows/Jobs, notebooks, materialized views, SQL table-valued functions
  • AWS and data stores: S3, RDS, Kafka, Aurora (PostgreSQL)
  • Platform and DevOps: GitHub, GitHub Actions, Docker, Kubernetes, ECS, EKS, Terraform
  • Collaboration: Jira, Confluence, Slack, There has never been a better time to join McGraw Hill. In our culture of curiosity and innovation, you will be able to own your growth and develop as we do! 51308

McGraw Hill uses an automated employment decision tool (AEDT) to assist in the screening process by recommending candidates with ā€œlike skillsā€ based on resume and job data. To request an alternative screening process, please select ā€œOpt-Outā€ when asked to ā€œConsent to use of Automated Employment Decision Toolsā€ during the application. McGraw Hill is an equal opportunity employer. McGraw Hill is committed to celebrating and supporting the differences that make us each unique and will not discriminate based on a person’s gender, gender identity or expression, nationality, color, race, ethnicity, religion, sexual orientation, disability, appearance or veteran status. We are proud to be an equal opportunity and affirmative action employer, and we will also provide reasonable accommodation to qualified individuals with disabilities.

Requirements

  • 5+ years of software or data engineering experience, including 3+ years building production data pipelines on Databricks or an equivalent Spark platform in AWS
  • Experience delivering production-grade, fault-tolerant software in a fast-paced environment with a distributed team
  • Advanced SQL skills, including tuning complex analytical queries over large datasets
  • Expertise in data warehousing, lakehouse concepts, data modeling, and cloud data architecture
  • Strong applied knowledge of several of: Unity Catalog governance, batch and incremental ETL/ELT, Spark performance tuning, REST services, AWS data services (Athena, Glue, EMR, Lambda), Terraform, GitHub Actions, and Git
  • A Bachelor’s degree in Computer Science or a related field, or equivalent experience

Nice to have:

  • Education or publishing domain experience
  • Streaming/CDC ingestion (e.g., Kafka) into Delta Lake
  • Data quality frameworks (Delta Live Tables, Great Expectations)
  • Databricks certification

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on jobs.localjobnetwork.com
Prepare application

Good distractions

Loading talks and stories from around this role…