Data Engineer
Role details
Job location
Tech stack
Job description
Marktconform Medior, Junior Amsterdam This role requires a solid understanding of both the business context and its data needs, with a focus on building high-quality data pipelines on our Big Data Platform. As a Data Engineer at Adyen, you will be instrumental in maintaining our data infrastructure and ensuring smooth data flows across systems. Direct solliciteren Neem contact op, At Adyen, we treat data and data artifacts as first-class citizens. They form our backbone and drive the business and product insights we generate. To this end, Adyen is looking for a Data Engineer to join our team in Amsterdam. This role requires a solid understanding of both the business context and its data needs, with a focus on building high-quality data pipelines on our Big Data Platform. As a Data Engineer at Adyen, you will be instrumental in maintaining our data infrastructure and ensuring smooth data flows across systems., * Collaborative Solution Development: Engage with a diverse range of stakeholders, including data scientists, analysts, software engineers, product managers, and customers, to understand their requirements and craft effective solutions.
- Quality Pipelines and Architecture: Design, develop, deploy and operate high-quality production ELT pipelines and data architectures. Integrate data from various sources and formats, ensuring compatibility, consistency, and reliability.
- Data Best Practices: Help establish and share best practices in performance, code quality, data validation, data governance, and discoverability in your team and in other teams. Participate in mentoring and knowledge sharing initiatives.
- High Quality Data and Code: Ensure data is accurate, complete, reliable, relevant, and timely. Implement testing, monitoring and validation protocols for your code and data, leveraging tools such as Pytest.
- Performance Optimization: Identify and resolve performance bottlenecks in data pipelines and systems. Improve query performance and resource utilization to meet SLAs and performance requirements, using technologies Spark optimizations.
Requirements
- Experienced in Big Data: Around 5 years of experience working as a Data Engineer or in a similar role.
- Data & Engineering practices: You have a solid understanding of both Software and Data Engineering practices.
- Technical Super Star: Proficient in tools and languages such as: Python, PySpark, Airflow, Hadoop, Spark, Kafka, SQL, Git.
- Clear Communicator: Able to effectively communicate complex data-related concepts and outcomes to a diverse range of stakeholders.
- Self-starter: Capable of identifying opportunities, devizing solutions, and handling projects independently.
- Innovator: You have an experimental mindset with a 'launch fast and iterate' mentality.
- Data Culture Champion: Skilled in promoting a data-centric culture within technical teams and advocating for setting standards and continuous improvement.