Data Engineer
Role details
Job location
Tech stack
Job description
- Solution Design & Implementation: Design, implement, and maintain reliable and scalable software applications and data systems, with a strong focus on using Python as the primary development language.
- Data Pipeline Development: Utilize proven expertise with Apache Spark/Databricks and Azure Data Factory to build, optimize, and manage robust and efficient data pipelines.
- Database Management & Analysis: Serve as an expert in data analysis and querying, demonstrating strong database query skills in platforms like SQL Server/PostgreSQL.
- Production Support: Provide critical business support for production systems, including in-depth analysis and timely troubleshooting of problems, interacting with internal teams and business users throughout the application lifecycle.
- Collaboration & Teamwork: Work effectively with geographically diverse delivery groups (Business Analysts, QA Engineers, and Developers) and DevOps teams to ensure the delivery of high-quality solutions.
- Continuous Improvement & Innovation: Actively research and develop innovative technologies, striving for excellence and continuous improvement in software architecture, embracing Agile methodologies and building systems.
- DevOps and Agile Practice: Adhere to and champion the Agile methodology. Actively contribute to building DevOps maturity, ensuring the safe and reliable delivery of business incremental change and measurably improving delivery velocity.
Requirements
Do you have experience in Python?, We are seeking a highly experienced and motivated Senior Data & Software Engineer with a strong background in solution design, implementation, and data-intensive applications. The ideal candidate will possess deep expertise in Python, Apache Spark/Databricks, and the Azure data ecosystem, and will be a key player in developing reliable, scalable data applications while actively contributing to our DevOps maturity and Agile delivery process., * Overall Experience: Minimum of 6+ years of professional experience in software engineering, specifically in solution design and implementation.
- Python Expertise: 6+ years of hands-on software engineering experience in solution design and implementation using the Python software development language.
- Big Data Technologies: Proven expertise and practical, hands-on experience with Apache Spark and Databricks.
- Cloud Data Services: Strong experience with Azure Data Factory (ADF).
- Database Proficiency: Expert knowledge of data analysis and querying in relational databases such as SQL Server and/or PostgreSQL, with strong database query optimization skills.
- Methodologies: Deep understanding and experience working within Agile frameworks and building DevOps practices.
- Communication: Excellent communication and collaboration skills for interacting with cross-functional and global teams.