Python Data Engineer

Develop scalable and reliable data solutions to move data across multiple systems and sources in real-time and batch processing modes Design and develop data-centric software applications using modern technologies and Agile development practices Identify and implement innovative automation solutions within data engineering Implement technical solutions using modern cloud technologies while supporting existing legacy applications Collaborate with Product Owners, Scrum Masters, and other stakeholders to understand business requirements and establish strong partnerships Develop solutions using Python, Hadoop, Spark, AWS, and other Big Data technologies and tools Quickly evaluate new and legacy technologies and paradigms to support modernization and cutting-edge solutions Support applications in production, including resolving defects and implementing enhancements Investigate production defects, identify root causes, and develop appropriate solutions Provide production support and communicate clearly regarding incident resolution Lead projects and provide technical guidance and coaching to junior developers Evaluate new technologies and develop proof of concepts to assess their applicability Support the implementation of regulatory reporting product vision and communicate effectively with key partners

10+ years of experience Bachelor’s degree in Computer Science, Engineering, or a related field, or equivalent work experience

Skills Python PySpark AWS Hadoop Spark SQL Unix Environment Data Lake Technologies Delta Lake Big Data Technologies Technical Leadership Mentoring and Coaching Stakeholder Management Agile Delivery Production Support Technology Evaluation Automation and Modernization Regulatory Reporting Software Development Life Cycle CI/CD Practices