Senior Data Engineer - Incorta & PySpark

Ingest, transform, and integrate data from multiple sources (ERP, databases, flat files, APIs). Collaborate with business stakeholders to understand reporting and analytics requirements. Develop and maintain Incorta schemas, business views, and insights dashboards. Optimize query performance and data load processes within Incorta. Perform data validation, testing, and troubleshooting to ensure data accuracy. Integrate Incorta with enterprise systems such as SAP, Oracle, or other data sources. Monitor system performance and implement improvements for scalability and efficiency. Maintain documentation for data models, pipelines, and reporting solutions.

Strong hands-on experience with Incorta platform (schemas, dashboards, SPARK SQL). Proficiency in PySpark for data transformation and processing. Good understanding of data warehousing concepts and ETL processes. Experience working with large datasets (big data environment). Knowledge of SQL, Spark SQL, and data modeling techniques. Experience integrating data from ERP systems (SAP/Oracle). Strong analytical and problem-solving skills. Design and develop data models, schemas, and dashboards using Incorta. Build and optimize data pipelines using PySpark for large-scale data processing., Incorta Strong hands-on experience with Incorta platform Schemas Dashboards SPARK SQL Incorta business views Insights dashboards Data Engineering PySpark Data transformation and processing Data pipeline development and optimization Large-scale data processing Data ingestion and integration Data Warehousing & Modeling Data warehousing concepts ETL processes Data modeling techniques Schema design Databases & Big Data Experience working with large datasets (big data environment) SQL Spark SQL ERP & Integration Experience integrating data from ERP systems o SAP o Oracle Integration with databases, flat files, APIs, and other data sources Performance & Quality Query performance optimization Data load optimization Data validation Testing Troubleshooting Data accuracy assurance System performance monitoring Scalability and efficiency improvements Collaboration & Documentation Collaboration with business stakeholders to understand reporting and analytics requirements Documentation of data models, pipelines, and reporting solutions Soft Skills Strong analytical and problem-solving skills Skills: Digital : SAP Cloud Architecture ~ Digital : PySpark ~ MySQL Experience Required: 6-8