> Markdown version of [/jobs/ext/3935535-sr-director-software-engineering-data-platform-mdm-integration](https://www.wearedevelopers.com/jobs/ext/3935535-sr-director-software-engineering-data-platform-mdm-integration). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Sr. Director, Software Engineering - Data Platform & MDM Integration - **Company:** Sp Global, Inc. - **Location:** New York, NY, United States - **Experience:** Expert - **Salary:** $185,000.0 - $265,000.0 - **Contract:** Permanent contract - **Skills:** Artificial Intelligence, Amazon Web Services, Amazon S3, Microsoft Azure, Big Data, Cloud Computing, Data Architecture, Data Infrastructure, Data Integration, Extract Transform Load (ETL), Data Transformation, Distributed Computing Environment, Apache Hadoop, IBM InfoSphere (ETL Tools), Cloud Services, Tensorflow, Software Engineering, Enterprise Data Management, Data Processing, Large Language Models, Snowflake, Apache Spark, Technical Debt, Generative AI, Data Strategy, Kubernetes, Information Technology, Apache Flink, HuggingFace, Data Management, Machine Learning Operations, Data Lakehouse, Data Pipelines, Serverless Computing, Databricks - **Published:** October 26, 2026 - **Apply:** https://www.manhattanjobs.com/job.asp?id=3467325719&tx=JK1509FFK&pt=1&aff=0B19D771-A501-4A5E-8338-2A822B784D54&utm_source=Job%20Feed&utm_medium=textkernel&utm_campaign=DE&utm_term=0B19D771-A501-4A5E-8338-2A822B784D54 ## About the Role * Minimum 9 years of experience in software engineering and data platform development with proven track record in enterprise-scale solutions * Minimum 7 years of people management experience leading technical teams and driving organizational growth in fast-paced environments * Advanced expertise in cloud data platforms such as Databricks, Snowflake, or similar, with hands-on experience in data lakehouse architectures and ETL/ELT processes * Strong experience with cloud infrastructure including AWS services (such as S3, EMR, Glue, Lambda) or equivalent cloud platforms (Azure, GCP) * Proven leadership in large-scale data migrations and system modernization initiatives, with experience managing complex technical transformations, * Master's degree in Computer Science, Software Engineering, or related technical discipline with 13+ years of progressive software development and data architecture experience * Deep expertise in Master Data Management platforms such as NeoXam, Informatica MDM, or IBM InfoSphere, with proven success integrating enterprise data platforms * Advanced AI/ML and Generative AI experience including hands-on work with machine learning frameworks (such as MLflow, Kubeflow, or SageMaker) and LLM implementation using tools like LangChain, Hugging Face, or similar platforms * Extensive experience with Big Data technologies including distributed computing frameworks (such as Apache Spark, Hadoop, or Flink) and modern data processing architectures * Bachelor's degree in Computer Science, Engineering, or related technical field ## Description This team is essential to the division's data strategy, playing a key role in data transformation and leading efforts to replace legacy technical debt. The team embodies a strong commitment to delivering on business needs and demonstrates exceptional collaboration with both product and business partners, bringing high energy and dedication to their work while being known for their collaborative approach and strong technical expertise., * Lead strategic MDM integration initiatives - Architect and oversee seamless, high-volume data integration between Databricks lakehouse and NeoXam MDM platform, establishing foundational data architecture for multi-billion-dollar index-linked investment products * Drive advanced cloud data architecture - Utilize cutting-edge Databricks features including Unity Catalog, Delta Live Tables, and Serverless compute to optimize data pipelines and maximize performance for massive-scale financial datasets * Pioneer AI/ML automation solutions - Implement Databricks Mosaic AI and agentic frameworks to automate data transformation, quality assurance, and anomaly detection across the entire conversion lifecycle * Build and scale high-performing engineering teams - Lead, manage, and grow multiple teams of product-focused software and data engineers while mentoring their professional and technical development * Modernize legacy infrastructure - Spearhead mission-critical migration of legacy assets and terabytes of data to modern AWS cloud ecosystem, breaking monolithic applications into microservice architectures * Champion engineering excellence and innovation - Foster a culture of cutting-edge technology adoption, continuous improvement of software engineering practices, and delivery of scalable, resilient solutions, At S&P Global, we are committed to fostering a connected and engaged workplace where all individuals have access to opportunities based on their skills, experience, and contributions. Our hiring practices emphasize fairness, transparency, and merit, ensuring that we attract and retain top talent. By valuing different perspectives and promoting a culture of respect and collaboration, we drive innovation and power global markets., S&P Global is an equal opportunity employer and all qualified candidates will receive consideration for employment without regard to race/ethnicity, color, religion, sex, sexual orientation, gender identity, national origin, age, disability, marital status, military veteran status, unemployment status, or any other status protected by law. Only electronic job submissions will be considered for employment. If you need an accommodation during the application process due to a disability, please send an email to: EEO.Compliance@spglobal.com and your request will be forwarded to the appropriate person. US Candidates Only: The EEO is the Law Poster http://www.dol.gov/ofccp/regs/compliance/posters/pdf/eeopost.pdf describes discrimination protections under federal law. Pay Transparency Nondiscrimination Provision - https://www.dol.gov/sites/dolgov/files/ofccp/pdf/pay-transp_%20English_formattedESQA508c.pdf * - 10 - Officials or Managers (EEO-2 Job Categories-United States of America), IFTECH102 - Senior Management (EEO Job Group), SWP Priority - Ratings - (Strategic Workforce Planning)