Senior Data Engineer
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Tech stack
+21 more
Job description
This position is responsible for architecting, implementing, and optimizing complex data solutions. This role leads to the development of sophisticated data pipelines, warehouses, and analytics platforms while mentoring junior team members and collaborating with stakeholders to drive data-driven decision-making Responsibilities
- Data Architecture and Strategy - Design and implement scalable, efficient data architecture. Lead the development of data strategy aligned with business objectives. Evaluate and integrate new technologies to enhance data capabilities
- Advanced Data Pipeline Development - Architect and implement complex data pipelines for real-time and batch processing. Optimize data flows for high-volume, high-velocity data environments. Develop advanced ETL processes for diverse data sources.
- Data Governance and Quality Management - Establish and enforce data governance policies and best practices. Implement data quality frameworks and monitoring systems. Ensure compliance with data regulations and standards
- Performance Optimization and Troubleshooting - Analyze and optimize system performance for large-scale data operations. Troubleshoot complex data issues and implement robust solutions
- Mentorship and Knowledge Sharing - Mentor junior data engineers and provide technical guidance. Contribute to the development of best practices and standards. Collaborate with cross-functional teams to drive data literacy
Requirements
Bachelor’s Degree and 4 years of experience in Software application development and maintenance OR High School Diploma or GED and 8 years of experience in Software application development and maintenance
Preferred Area of Study: Computer Science, Information Systems, Data Science, or related field Preferred Area of Experience: Machine learning operations, data science ,Advanced data modeling and architecture, ETL processes and tools (e.g., DBTran, IICS, DataStage, SSIS, Apache Spark, Airflow, BODS), Big data technologies (e.g., Snowflake, Hadoop, Spark) (Expert, Required), Cloud data platforms (e.g., AWS, Azure, GCP) , Data streaming and real-time processing , Machine learning integration, BI and Data analytics ( e.g : BO , Tableau , Power BI )
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Apply on firstcitizens.comGood distractions
Talks and stories from around this role — technically off-topic, practically not.
Moments
Explore playlistsVideos
See allRelated articles
See all
Data Engineer Salary UK
Data Analyst Salary in the UK
Top Big Data Technologies That You Need to Know
Making Data Warehouses Fast: A Developer’s Story