Data Engineer
N E P
Edinburgh, United Kingdom
2 days ago
Role details
Contract type
Permanent contract Employment type
Full-time (> 32 hours) Working hours
Regular working hours Languages
English Experience level
SeniorJob location
Edinburgh, United Kingdom
Tech stack
Big Data
Continuous Integration
Information Engineering
Data Governance
Data Infrastructure
ETL
Data Visualization
Python
Machine Learning
Performance Tuning
SQL Databases
Management of Software Versions
Snowflake
Spark
Data Lake
Data Management
Data Pipelines
Databricks
Job description
We're looking for an experienced Data Engineer to help design, build, and optimize modern data pipelines that power analytics, BI, and machine learning across NEP Group. In this role, you'll develop scalable ETL/ELT workflows feeding Snowflake and Databricks, collaborate closely with BI and ML teams, and continuously improve our data platform to support a growing global organization.
If you enjoy working with large datasets, modern cloud tools, and solving complex data challenges, this is a chance to make a real impact. What You'll Do:
- Design, develop, and automate ETL/ELT pipelines feeding Snowflake and Databricks
- Build and maintain scalable ingestion pipelines using dbt, Databricks, and Fivetran
- Optimize queries, data partitioning strategies, and schema design for performance and cost
- Partner with BI and ML teams to support analytics and advanced data use cases
- Identify opportunities to improve data infrastructure and implement best-practice solutions
- Troubleshoot data issues and provide technical guidance and support
- Contribute to ongoing improvements in reliability, scalability, and data quality, You might not know our name, but you've probably seen our work - on stage, on screen or on the field. Our technology solutions and unique Global Production Ecosystem empower content creators and rights holders to tell their stories in breakthrough ways. We've supported some of the world's most watched productions and live events in sports, entertainment, concerts, festivals, film, TV and more. For 40 years our clients have trusted us to deliver live production, live events, and virtual production solutions for them, anytime, anywhere. Put simply, we bring content to life.
Requirements
- 5+ years of experience in data engineering with strong Python, SQL, and Spark skills
- Hands-on experience building and automating ETL/ELT pipelines and working with data warehouses
- Solid understanding of data modeling, schema design, and performance optimization
- Experience with cloud-based data platforms such as Databricks and modern storage solutions (e.g., Delta Lake)
- Familiarity with CI/CD, data versioning, and best practices for scalable data infrastructure
- Knowledge of data governance, data quality, and lineage concepts
- Understanding of cloud cost optimization, security, and access control best practices
About the company
NEP UK, part of the NEP Worldwide Network, is a global leader in outside broadcasting, remote production, and media workflow solutions. Known for delivering high-quality broadcasts for clients like The Grand National, Wimbledon Championships, Premiership Football, Squid Games, and Love Island, NEP UK prides itself on its innovative technology, passionate team, and unwavering commitment to excellence.