> Markdown version of [/jobs/ext/1508660-senior-incorta-data-engineer](https://www.wearedevelopers.com/jobs/ext/1508660-senior-incorta-data-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Senior Incorta Data Engineer - **Company:** Purple Drive Technologies LLC - **Location:** Newton, MA, United States - **Experience:** Expert - **Contract:** Permanent contract - **Skills:** Query Performance, Application Programming Interfaces (APIs), Agile Methodology, Business Analytics Applications, Business Intelligence Development, Big Data, Databases, Data Validation, Information Engineering, Data Files, Data Integration, Extract Transform Load (ETL), Data Transformation, Data Warehousing, Dimensional Modeling, File Systems, Distributed Computing Environment, Distributed Systems, Monitoring of Systems, Apache Hive, Oracle (Applications), Performance Tuning, Scrum Methodology, Systems Development Life Cycle, Power BI, Standard Sql, SAP (Applications), SQL Databases, Tableau (Software), Enterprise Data Management, Data Processing, Scripting, Enterprise Software Applications, Cloud Platform System, Data Ingestion, SAP Integration Solutions, Apache Spark, Build Management, Pyspark, Semi-structured Data, Information Technology, Performance Monitor, Star Schema, Tools for Reporting, Restful APIs, Oracle Integration, Data Pipelines - **Published:** July 30, 2026 - **Apply:** https://www.careerjet.com/jobad/us9a57dd9f421208a2553aed511d5af4c2 ## About the Role * Bachelor's degree in Computer Science, Information Technology, Engineering, or a related field. * 6-8 years of experience in Data Engineering or Business Intelligence. * Strong hands-on experience with the Incorta platform. * Expertise in PySpark, Spark SQL, and SQL. * Experience with ETL processes and enterprise data warehousing. * Experience integrating data from SAP, Oracle, and enterprise databases. * Strong analytical and problem-solving skills. * Excellent communication and stakeholder management abilities., * Experience working in Big Data environments. * Knowledge of cloud-based data platforms. * Experience with Apache Spark ecosystems. * Exposure to Power BI or Tableau. * Experience with CI/CD pipelines. * Familiarity with Python scripting. ## Description We are seeking an experienced Senior Incorta Data Engineer to design, develop, and optimize enterprise reporting and analytics solutions using the Incorta platform. The ideal candidate should possess strong expertise in Incorta schemas, dashboards, Spark SQL, PySpark, SQL, ETL, data warehousing, and ERP data integration (SAP/Oracle). The candidate will be responsible for building scalable data pipelines, integrating data from multiple enterprise sources, developing business dashboards, optimizing query performance, and ensuring high-quality reporting solutions in a large-scale data environment., Incorta Development * Design, develop, and maintain Incorta schemas, Business Views, and Insights Dashboards. * Build scalable and high-performing analytics solutions using the Incorta platform. * Develop interactive dashboards and reports for business users. * Optimize Incorta query performance and data load processes. * Manage Incorta data models and schema design. Data Engineering & Pipeline Development * Design and build scalable ETL/data pipelines using PySpark. * Develop data ingestion frameworks for structured and semi-structured data. * Process large-scale datasets efficiently in distributed environments. * Integrate data from databases, APIs, flat files, ERP systems, and cloud sources. * Ensure data quality, consistency, and reliability throughout the data lifecycle. Data Warehousing & Data Modeling * Design enterprise data warehouse solutions. * Develop logical and physical data models. * Create optimized schemas for analytics and reporting. * Apply dimensional modeling techniques and ETL best practices. * Support enterprise reporting and business intelligence initiatives. ERP & Enterprise Data Integration * Integrate data from: * SAP * Oracle * SQL Databases * REST APIs * Flat Files * Enterprise Applications * Build reliable integration pipelines for business-critical data. * Ensure seamless synchronization between ERP systems and analytics platforms. Performance Optimization * Optimize SQL and Spark SQL queries. * Improve data load performance within Incorta. * Monitor system performance and identify bottlenecks. * Enhance scalability and efficiency of data processing workflows. Testing & Data Validation * Perform data validation and reconciliation. * Troubleshoot ETL and reporting issues. * Validate business data accuracy and completeness. * Support testing of dashboards and reporting solutions. Collaboration * Collaborate with business stakeholders to gather reporting and analytics requirements. * Work closely with Data Architects, BI Developers, and Business Analysts. * Participate in Agile ceremonies and project planning. * Provide technical support and mentoring to junior developers. Documentation * Maintain technical documentation for: * Data models * ETL pipelines * Incorta schemas * Dashboard designs * Reporting solutions * Create operational runbooks and deployment documentation. Required Skills Incorta * Incorta Platform * Schema Development * Business Views * Insights Dashboards * Dashboard Development * Spark SQL Data Engineering * PySpark * Data Pipeline Development * Data Transformation * Data Processing * Data Ingestion * Data Integration Data Warehousing * Data Warehousing Concepts * ETL Processes * Data Modeling * Schema Design * Star Schema * Snowflake Schema Big Data * SQL * Spark SQL * Large Dataset Processing * Distributed Data Processing ERP Integration * SAP Integration * Oracle Integration * Database Integration * REST APIs * Flat File Processing Performance & Quality * Query Performance Optimization * Data Load Optimization * Data Validation * Testing * Troubleshooting * Performance Monitoring * Scalability Improvements Methodologies * Agile * Scrum * SDLC ## Related Videos - [Alibaba Big Data and Machine Learning Technology](https://www.wearedevelopers.com/videos/37-alibaba-big-data-and-machine-learning-technology) - [PySpark - Combining Machine Learning & Big Data](https://www.wearedevelopers.com/videos/44-pyspark-combining-machine-learning-big-data) - [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works) - [Beyond Dashboards: Fixing Text-to-SQL with Semantic RAG](https://www.wearedevelopers.com/videos/2036-beyond-dashboards-fixing-text-to-sql-with-semantic-rag) - [Data Science in Retail](https://www.wearedevelopers.com/videos/586-data-science-in-retail) - [Data Analytics with Microsoft Fabric: End-to-End Use Case with Data Agents](https://www.wearedevelopers.com/videos/1547-data-analytics-with-microsoft-fabric-end-to-end-use-case-with-data-agents) ## Related Articles - [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story) - [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers) - [Coffee with Developers - Maria Apazoglou - Making AI understandable for all in production](https://www.wearedevelopers.com/magazine/475-coffee-with-developers-maria-apazoglou-making-ai-understandable-for-all-in-production) - [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know) - [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk) - [How We Built a Worry-Free System That Runs for 10+ Years – And What We’d Do Again](https://www.wearedevelopers.com/magazine/751-how-we-built-a-worry-free-system-that-runs-for-10-years-and-what-we-d-do-again)