Senior Data Engineer

Experteer Overview In this role you will build and optimize data pipelines for Prudential’s financial data lakes, partnering with architects, engineers and data experts to deliver high-quality, scalable data solutions. You will analyze data, support prescriptive and predictive modeling, and contribute to platform delivery with modern design patterns. You’ll work across cross-functional teams to improve data reliability and enable data-driven decisions, with a strong focus on learning and innovation. Compensation / Benefits * Build and optimize data pipelines, logic and storage systems following industry standards * Develop high-quality, well-documented code adhering to Prudential standards * Conduct complex data analysis and prepare data for modeling, integrating multiple sources * Collaborate with analysts, scientists and architects to improve data acquisition, transformation and quality * Write unit/integration tests and automate validation to address quality issues * Apply emerging technologies and share learning to drive day-to-day innovation * Tackle complex problems requiring in-depth analysis * Utilize programming languages including Python, R, SQL, Java, Scala, PySpark/Apache Spark, Shell scripting Tasks * Bachelor in Computer Science or Engineering or related field * Experience with DevOps automation and SDLC * Strong problem solving, communication and collaboration skills * Ability to continuously learn new skills * Applied experience with Python, R, SQL, Java, Scala, PySpark/Spark, Shell scripting * Experience with data ingestion, integration and transformation across multiple sources * Experience with relational and NoSQL databases, data warehousing tools, and data lake concepts * Knowledge of AWS and cloud-based architectures * Experience with testing (unit/integration) and quality assurance in a DevOps context Key requirements * competitive base salary * medical, dental, vision insurance * 401(k) with company match * pension plan * paid time off and parental/military leave * education benefits

_ technologies and share learning to drive day-to-day innovation * Tackle complex problems requiring in-depth analysis * Utilize programming languages including Python, R, SQL, Java, Scala, PySpark/Apache Spark, Shell scripting Tasks * Bachelor in Computer Science or Engineering or related field * Experience with DevOps automation and SDLC * Strong problem solving, communication and collaboration skills * Ability to continuously learn new skills * Applied experience with Python, R, SQL, Java, Scala, PySpark/Spark, Shell scripting * Experience with data ingestion, integration and transformation across multiple sources * Experience with relational and NoSQL databases, data warehousing tools, and data lake concepts * Knowledge of AWS and cloud-based architectures * Experience with testing (unit/integration) and quality assurance in a DevOps context Key requirements * competitive base salary * medical, dental, vision insurance * 401(k) with company match * pension plan * paid time off a R, parental/military leave * education benefits