Engineer - Data Platform Team
Role details
Job location
Tech stack
Job description
The mission of the Data Science/Data Engineering team at Confluent is to serve as the central nervous system of all things data for the company: we build data and analytics infrastructure, insights, models and tools, to empower data-driven thinking, and optimize every part of the business. This position offers limitless opportunities for an ambitious data engineering leader to make an immediate and meaningful impact within a hyper-growth start-up, and contribute to a highly engaged open source community. This is a partnership-heavy role. As a Team Lead within the Data organization, you will enable various functions of the company, . Product, Engineering, Field Operations, Go-to-Market, etc., to be data-driven while providing leadership and direction to your team. As a Data Engineer, you will take on big data challenges in an agile way. You will participate and guide your team in building data pipelines that enable data scientists, analytics partners, operation teams, and executives to make data accessible to the entire company. You will also build data models to deliver insightful analytics while ensuring the highest standard in data integrity. You are encouraged to think out of the box and play with the latest technologies while exploring their limits. Successful candidates will have strong technical capabilities, leadership experience, a can-do attitude, and are highly collaborative.
What You Will Do: Lead a team of data engineers, providing technical guidance, mentorship, and career developmentPartner with stakeholders across the organization to understand business needs, prioritize features, and develop strategic data solutionsBreak down complex projects into manageable tasks and assign them to team members based on their strengths and development goalsDesign, build and launch extremely efficient and reliable data pipelines to move data across many platforms including Data Warehouse and real-time systemsDeveloping strong subject matter expertise and managing the SLAs for those data pipelinesSet up and improve BI tooling and platforms to help the team create dynamic tools and reportingPartnering with Data Scientists and business partners to develop internal data products to improve operational efficiencies organizationallyFoster a culture of innovation, collaboration, and technical excellence within your teamRepresent the data engineering team in cross-functional meetings and advocate for technical best practices
Here are some examples of our work: Data Pipelines - Create new pipelines or rewrite existing pipelines using SQL, Python on Airflow & DBTData Quality and Anomaly Detection - Improve existing tools to detect anomalies real time and through offline metricsData Modeling - Partner with analytic consumers to improve existing datasets and build new onesTechnical Leadership - Guide the team towards maintaining a high technical bar while collaborating with stakeholders to deliver overall impact, A leading tech recruitment agency is seeking a Lead Software Engineer - Data in Greater London. This role involves leading a small team in revamping a Data platform with a focus on scalability. Ideal candidates will have experience with GCP or AWS, data infrastructure, and..., A global biopharma company is looking for a Staff Engineering & Team Lead in London. Responsible for leading a team of data engineers, this position focuses on building scalable data pipelines and influencing the engineering direction of the Onyx platform. Candidates must..., Data Engineer, Team Lead - Contract 3 month contract - outside IR35This role will sit within a global data team for a large brand, and will service multiple high priority projects across a portfolio, with data at the heart of it.You'll bring significant long-term experience..., A fast-growing financial solutions provider in Whiteley is seeking a proactive Financial Controller to lead their finance team. This hybrid role involves overseeing daily operations, maintaining an accurate general ledger, and delivering high-quality management accounts...., A fast-growing fintech startup in Greater London is seeking a talented Data Team Lead to manage a skilled team of data engineers. You will oversee project management, set team goals, and ensure data governance and efficiency in data ingestion pipelines. Candidates should..., A leading logistics firm in Greater London is looking for a Data Engineering Lead to enhance data products and modernize data infrastructure. You will manage a team of data engineers, driving efficiency and innovation while aligning solutions with business strategies. The..., A market leading manufacturing company in the UK is seeking an Engineering Team Leader to oversee a maintenance team in a dynamic FMCG environment. Responsibilities include providing engineering advice, managing improvement projects, and leading a team of engineers. The...
Requirements
6+ years of experience in a Data Engineering role, with a focus on data warehouse technologies, data pipelines, and BI tooling1-3 years of team leadership, management, or equivalent project leadership experience (formal management preferred, but will consider dotted line management or technical leadership roles)Bachelor or advanced degree in Computer Science, Mathematics, Statistics, Engineering, or related technical disciplineExpert knowledge of SQL and relational & cloud database systems and conceptsStrong knowledge of data architectures, data modelling and data infrastructure ecosystemExperience with enterprise business systems such as Salesforce, Marketo, Zendesk, Clari, Anaplan, etcExperience with ETL pipeline tools like Airflow, and DBT, and with code version control systems like GitDemonstrated ability to see the big picture and translate business needs into technical requirementsStrong stakeholder management skills and ability to effectively prioritize competing demandsThe ability to communicate cross-functionally, derive requirements and architect shared datasets; the ability to synthesize, simplify, and explain complex problems to different types of audiences, including executivesProven track record of mentoring junior engineers and helping them grow technicallyThe ability to thrive in a dynamic environment. That means being flexible and willing to jump in and do whatever it takes to be successful
What Gives You an Edge: Experience with Apache KafkaKnowledge of batch and streaming data architecturesProduct mindset to understand business needs, and come up with scalable engineering solutionsPrevious experience scaling data teams and establishing data engineering best practicesExperience balancing technical debt with new feature developmentSuccess in translating business objectives into actionable technical roadmaps, A leading technology services firm is looking for an experienced Business Analyst to lead efforts in data-driven decision-making and team management. The ideal candidate will have a strong background in business analysis, excellent leadership skills, and the ability to..., A consulting firm in the UK is searching for a Business Analyst to lead efforts in business analysis. The ideal candidate should have 5-7 years of experience, strong leadership skills, and proficiency in data analysis tools. Responsibilities include managing a team,...
Benefits & conditions
Job Description Senior / Lead Data Engineer London, Hybrid. (1-3 Days in London) Up to £90,000 plus 25% bonus. This is an exciting opportunity to lead data engineering within a growing organisation that is scaling its cloud data platform. You will take technical..., Senior Linux Engineer / Team Lead True High Performance Computing Systems Hybrid Working with Offices near Haywards Heath, West Sussex Package: Salary Circa £65k DOE + Benefits + Bonus Join an international, next-generation HPC data centre organisation as a Senior HPC...
