> Markdown version of [/jobs/ext/1283503-data-engineer](https://www.wearedevelopers.com/jobs/ext/1283503-data-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Data Engineer - **Company:** New York State Technology Enterprise Corporation - **Location:** Albany, NY, United States - **Experience:** Expert - **Salary:** $97,172.0 - $126,323.0 - **Contract:** Permanent contract - **Skills:** Application Programming Interfaces (APIs), Artificial Intelligence, Data Analysis, Microsoft Azure, Business Systems, Information Systems, Databases, Data Architecture, Information Engineering, Data Governance, Data Integration, Data Integrity, Extract Transform Load (ETL), Data Transformation, Data Systems, Data Warehousing, Relational Databases, Database Design, Python (Programming Language), Microsoft Data Access Components, Meta-Data Management, Microsoft SQL Server, SQL Azure, Performance Tuning, Query Optimization, Cloud Services, Azure Data Lake, SQL Databases, SQL Server Integration Services, Enterprise Data Management, Enterprise Software Applications, Azure Data Factory, Microsoft Fabric, Pyspark, Information Technology, Software Version Control, Data Pipelines - **Published:** July 15, 2026 - **Apply:** https://www.indeed.com/viewjob?jk=e43f810dbefdcbc9 ## About the Role * Experience developing enterprise data solutions using Microsoft Fabric. Candidates with equivalent experience using Microsoft Azure Data Factory, Azure Data Lake Storage, Azure SQL, SQL Server Integration Services (SSIS), SQL Server, or related Microsoft data services in cloud or on-premises environments will also be considered. * Advanced SQL development skills, including query optimization, database design, and performance tuning. * Strong proficiency in Python and/or PySpark for data engineering, automation, and data transformation. * Experience designing and developing ETL/ELT solutions and enterprise data integration processes. * Experience designing and supporting relational databases, data warehouses, lakehouses, and enterprise analytical data models. * Experience integrating data from enterprise applications, APIs, relational databases, flat files, and cloud services. * Strong understanding of enterprise data architecture, data modeling, data governance, metadata management, and security best practices. * Experience implementing source control, testing, deployment, and operational support practices for enterprise data solutions. * Excellent analytical, troubleshooting, organizational, and communication skills. Preferred/Desired Qualifications * Experience supporting enterprise Business Intelligence, analytics, and AI initiatives through modern data engineering practices. * Experience implementing data governance, security, and performance optimization within Microsoft enterprise data platforms. * Microsoft Certified: Fabric Analytics Engineer Associate (DP-600), Azure Data Engineer Associate (DP-203), or similar Microsoft certification preferred. Education and Experience * A bachelor's degree in computer science, information systems, data engineering, information technology or a related discipline and five years of related experience designing, developing and supporting enterprise platforms. * An equivalent combination of advanced education, training, and experience will be considered., Applicants must be authorized to work in the United States without the need for visa sponsorship now or in the future. ## Description The Data Engineer designs, develops, and maintains NYSTEC's enterprise data platform and data integration solutions. This role builds scalable, secure, and high-performing data pipelines, data warehouses, lakehouses, and related data solutions that support reporting, analytics, artificial intelligence initiatives, and data-driven decision-making. The position works closely with the Business Intelligence team, internal technology teams, and business stakeholders to integrate data from multiple systems, improve data quality and governance, and support the continued maturity of NYSTEC's enterprise data platform., Design, develop, and maintain scalable enterprise data pipelines that support the organization's data integration, analytics, and business intelligence initiatives. * Design, implement, and support enterprise data architecture, including data warehouses, lakehouses, and other analytical data repositories. * Develop and maintain robust ETL (Extract, Transform, Load) and ELT (Extract, Load, Transform) processes to ingest, transform, validate, and deliver data from multiple internal and external business systems. * Design and implement logical and physical data models that promote consistency, scalability, and long-term maintainability. * Develop, test, deploy, and maintain data engineering solutions that leverage SQL, Python, and PySpark to support enterprise data processing and automation. * Integrate data from enterprise applications, APIs, relational databases, flat files, and third-party systems while ensuring data integrity and reliability. * Implement and maintain enterprise data governance standards, including data quality, metadata management, lineage, security, and access controls. * Monitor, troubleshoot, and optimize enterprise data pipelines, databases, and platform performance to ensure reliability, scalability, and operational efficiency. * Collaborate with business stakeholders, application owners, and technical teams to translate business requirements into scalable data solutions. * Develop and maintain technical documentation, including solution architecture, operational procedures, and development standards. * Evaluate emerging technologies and recommend improvements that enhance the organization's enterprise data platform, data engineering practices, and overall data maturity. * Partner with Business Intelligence team members to ensure enterprise data assets effectively support reporting, advanced analytics, artificial intelligence, and self-service data initiatives. * Participate in platform planning, architecture reviews, and continuous improvement efforts to ensure the enterprise data platform remains secure, scalable, and aligned with organizational objectives. ## Related Videos - [PySpark - Combining Machine Learning & Big Data](https://www.wearedevelopers.com/videos/44-pyspark-combining-machine-learning-big-data) - [Hacking MSSQL on Cloud. All of them. How I became sysadmin on Azure, AWS, GCP and Alibaba.](https://www.wearedevelopers.com/videos/100339-hacking-mssql-on-cloud-all-of-them-how-i-became-sysadmin-on-azure-aws-gcp-and-alibaba) - [Kubernetes and Microservices with Multi-Model Databases](https://www.wearedevelopers.com/videos/382-kubernetes-and-microservices-with-multi-model-databases) - [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works) - [Empowering Retail Through Applied Machine Learning](https://www.wearedevelopers.com/videos/976-empowering-retail-through-applied-machine-learning) - [Automated MS SQL Server database deployments with dacpacs and Azure DevOps](https://www.wearedevelopers.com/videos/334-automated-ms-sql-server-database-deployments-with-dacpacs-and-azure-devops) ## Related Articles - [What Are The Top Skills Required For Azure Developers?](https://www.wearedevelopers.com/magazine/77-what-are-the-top-skills-required-for-azure-developers) - [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk) - [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know) - [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story) - [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers) - [How to Become an AI Engineer](https://www.wearedevelopers.com/magazine/331-how-to-become-an-ai-engineer)