Data Engineer II
Role details
Job location
Tech stack
Requirements
Key Responsibilities * Design, build, and maintain scalable and efficient data pipelines and ETL/ELT processes. * Contribute to the optimisation of existing data workflows and applications for performance and resource efficiency. * Write, test, and deploy data transformation jobs using tools like dbt. * Work with streaming data frameworks and infrastructure to process real-time and near real-time data. * Support the development and maintenance of data models within our cloud data warehouse (Big Query). * Collaborate with data scientists, BI developers, analytics engineers, and other data engineers to understand data requirements and deliver reliable data solutions. * Implement data quality checks and monitoring to ensure data accuracy and reliability. * Participate in code reviews and contribute to the team's engineering standards and best practices. * Troubleshoot and resolve issues related to data pipelines and data infrastructure. * Learn and apply new technologies and techniques in the data engineering space. Qualifications * Proficiency in at least one programming language commonly used in data engineering (e.g., Python, Java, Scala). * Understanding of data warehousing concepts and experience working with a cloud data warehouse (e.g., BigQuery, Snowflake). * Experience with SQL and working with relational databases. * Experience with data streaming frameworks (e.g., Apache Beam, Flink). * Experience with streaming infrastructure (e.g., Kinesis, Pub/Sub). * Familiarity with workflow orchestration tools like Airflow (GCP Composer). * Experience with data transformation tools like dbt. * Experience deploying with containerisation technologies like Docker. * Understanding of data governance principles. * Ability to work effectively in a team environment and collaborate with technical and non-technical stakeholders. * Good communication skills and attention to detail. *, Bachelor's degree in Computer Science, Engineering, Mathematics, or a
Benefits & conditions
related technical field, What We Offer * Competitive compensation * Employee Stock Purchase Plan (ESPP) * Flying Start - Our immersive Global Induction Program * Dynamic & Global Team * Wellbeing Programs (Mental Health, Wellness) with Global FlyMates * Be a meaningful part in our success - every FlyMate makes an impact * Competitive time off including FlyBetter Days to volunteer in a cause you believe in * Digital Disconnect Days * Great Talent & Development Programs Flywire is an equal opportunity employer.