Data Platform Engineer
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Tech stack
+27 more
Job description
This position serves as a Data Engineer within the Data Engineering and Architecture (DEA) team in Institutional Research and Enterprise Data Management (IREDM), a division of Information Technology Services (ITS). The individual will play a key role in designing, developing, and maintaining data pipelines; supporting Azure-based data services; and ensuring data quality, usability, accessibility, and performance., The position will leverage tools such as Azure Data Factory, Databricks, and Azure Data Lake Storage to deliver trusted data assets that support decision-making across all areas of the University, including student success, academic planning, finance, and research. This position is eligible for teleworking; however, some in-person assignments may be necessary at the supervisor’s discretion., Key Responsibility Build and Maintain Data Pipelines Essential Tasks
- Design, develop, and manage ETL/ELT pipelines using Azure Data Factory and Databricks.
- Ingest and integrate structured and semi-structured data from enterprise systems into the data platform.
- Ensure reliability, reusability, cost efficiency, and performance of data movement and transformation processes.
- Translate institutional requirements into scalable data models and transformations in collaboration with data architecture and stakeholders.
Percentage Of Time 15% Key Responsibility Administer and Support the Enterprise Data Platform Essential Tasks
- Assist with configuration, monitoring, and maintenance of Azure Data Lake and Databricks services.
- Implement data quality, security, and governance standards and controls.
- Monitor workloads and optimize for performance and cost.
- Produce technical documentation and operational runbooks.
- Support internal and external data integrations by assisting with secure connectivity between enterprise applications and the data platform, in collaboration with data architecture, infrastructure and information security teams.
- Help troubleshoot data access, authentication, and connectivity issues impacting pipelines and data consumers.
Percentage Of Time 10% Key Responsibility Automation and DevOps Practices Essential Tasks
- Contribute to automation efforts using CI/CD pipelines and Infrastructure as Code.
- Develop and maintain reusable deployment templates and standards.
- Improve operational efficiency and reduce manual interventions through scripting and tooling
Percentage Of Time 10% Key Responsibility Other departmental duties as needed Essential Tasks
- Supporting the administration of Databricks.
- Helping to ensure the overall health and security of the enterprise data environment.
- Working with data architecture to develop advanced platform administration skills while contributing directly to the University’s data-driven initiatives.
ADA Checklist
ADA Checklist
R for Rare (0-30%), O for Occasional (30-60%), F for Frequent (60-90%), C for Constant (90-100%). Physical Effort Hand Movement-Repetitive Motions - f, Hearing - f, Talking - f, Sitting - f Work Environment Inside - c
Applicant Documents
Required Documents
- Resume/CV
- Cover Letter
- List of References
Optional Documents
- Reference Letter 1
- Reference Letter 2
- Reference Letter 3
Requirements
- Bachelor’s degree in a related discipline or 4+ years of professional experience in data engineering or related field or equivalent combination of education/experience.
Additional Required Certifications, Licensures, and Certificates Preferred Qualifications
- Strong SQL proficiency (T-SQL, Spark SQL) for analytics and troubleshooting.
- Experience with Azure SQL databases / RDBMS development and performance tuning skills.
- Hands on experience developing ETL/ELT data pipelines, administering and supporting the data warehousing and analytics infrastructure.
- Demonstrated experience in Databricks and Azure Data Factory or similar technologies (examples, Microsoft Fabric, Informatica, Snowflake, Qlik).
- Proficiency in Python for data engineering.
- Experience with Git and CI/CD practices for data pipeline deployment.
- Ability to document and communicate technical solutions to technical and non-technical stakeholders.
- Familiarity with Azure Data Lake Storage.
- Exposure to Infrastructure-as-Code concepts (Databricks Asset Bundles preferred; Terraform, Bicep, or ARM templates a plus).
- Experience with data modeling (dimensional/star schema).
- Familiarity with governance and metadata management tools.
- Knowledge of higher education data systems (student, HR, finance, etc.).
- Familiarity with data architecture concepts.
About the company
Located in North Carolina’s third largest city, UNC Greensboro is among the most diverse, learner-centered public research universities in the state, with 18,000 students in eight colleges and schools pursuing more than 150 areas of undergraduate and over 200 areas of graduate study. UNCG continues to be recognized nationally for academic excellence, access, and affordability. UNCG is ranked No. 1 most affordable institution in North Carolina for net cost by the N.Y. Times and No. 1 in North Carolina for social mobility by The Wall Street Journal - helping first-generation and lower-income students find paths to prosperity. Designated an Innovation and Economic Prosperity University by the Association of Public and Land-grant Universities, UNCG is a community-engaged research institution with a portfolio of more than $67M in research and creative activity. The University’s 2,600 staff help create an annual economic impact for the Piedmont Triad region in excess of $1B. Primary Purpose of the Organizational Unit The Data Engineering and Architecture team is responsible for building and supporting UNCG’s enterprise data platform. The team develops reliable data pipelines, administers cloud-based services, and maintains the infrastructure that powers analytics and reporting across the University. In addition to day-to-day engineering, the team ensures the stability, security, and operational continuity of the University’s data environments.
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Good distractions
Talks and stories from around this role — technically off-topic, practically not.
Moments
Explore playlistsVideos
See allRelated articles
See all
Data Analyst Salary in the UK
What Are The Top Skills Required For Azure Developers?
Top Big Data Technologies That You Need to Know
The Most Popular IT Jobs on the Market