> Markdown version of [/jobs/ext/3546871-data-engineer](https://www.wearedevelopers.com/jobs/ext/3546871-data-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Data Engineer - **Company:** Abacus - **Location:** Charlotte, NC, United States - **Contract:** Permanent contract - **Skills:** .NET Framework, Application Programming Interfaces (APIs), Business Logic, Application Services, Microsoft Azure, BASIC (Programming Language), C Sharp (Programming Language), Cloud Storage, Code Review, Data Validation, Information Engineering, Data Integration, Extract Transform Load (ETL), Data Security, Data Visualization, Data Warehousing, Relational Databases, Software Debugging, DevOps, Python (Programming Language), Microsoft SQL Server, SQL Azure, Power BI, Standard Sql, DataOps, Security Information and Event Management, Software Engineering, SQL Stored Procedures, SQL Databases, Transact-SQL, Data Processing, Data Ingestion, Azure Data Factory, Git, Data Analytics, Restful APIs, Azure Synapse Analytics, Software Version Control, Data Pipelines, Serverless Computing - **Published:** September 30, 2026 - **Apply:** https://www.indeed.com/viewjob?jk=045d792db134b78e ## About the Role * Bachelor's Degree - Preferred, * 1-4 years of professional experience in Data Engineering, Software Engineering, or a related technical role - Required * Strong hands-on proficiency in Python, including writing functions, handling errors, and debugging code - Required * Experience working with relational databases, preferably SQL Server - Required * Strong working knowledge of SQL, including joins, aggregations, subqueries, and basic performance considerations - Required * Exposure to integrating or consuming data from RESTful APIs or external data sources - Required * Familiarity with Git or similar version control systems - Required * Strong analytical and problem-solving skills with the ability to learn quickly - Required Preferred Experience * Experience with additional Azure services such as Azure Synapse, Azure DevOps, and Azure Functions * Understanding of data modeling and warehousing concepts * Exposure to cybersecurity data, SIEM tools, or SOC operations * Knowledge of .NET Framework and C#-based APIs, particularly in data consumption contexts * Background in MSP/MSSP environments or consulting * Familiarity with Power BI or other data visualization tools Knowledge, Skills, and Abilities: * Exposure to Azure data services such as Azure Data Factory, Azure SQL, or Blob Storage. * Basic understanding of ETL concepts, data validation, and pipeline monitoring. * Familiarity with data modeling fundamentals, including tables, keys, and relationships. * Awareness of data security, privacy, and compliance standards such as HIPAA and SOC2. * Experience with Power BI or other data visualization tools. * Basic understanding of application systems or APIs built using .NET or similar frameworks. * Ability to design and support scalable ETL pipelines using Python and SQL Server for data ingestion, transformation, and integration from diverse sources. * Ability to develop and optimize T-SQL stored procedures to support business logic and reporting needs. * Ability to support secure and efficient data workflows using Azure Data Factory, Azure SQL, and Azure Functions. * Ability to help ensure data quality, lineage, and compliance requirements are maintained. * Ability to collaborate with software engineering, data analytics, security, and DevOps teams. * Ability to monitor and troubleshoot pipeline failures and data discrepancies. * Ability to participate in code reviews and continuously improve engineering practices. Attributes that will drive success: * Ability to work effectively in a collaborative, fast-paced environment. * Good written and verbal communication skills. ## Description * Develop and maintain ETL pipelines using Python and SQL Server for data ingestion, transformation, and integration from various data sources, including structured files and RESTful APIs. * Write, test, and debug Python code for data processing, automation, and basic integrations following established standards and best practices. * Create and maintain T-SQL queries, views, and stored procedures to support business logic and reporting requirements. * Assist in building and operating data workflows using Azure Data Factory, Azure SQL, and Azure Blob Storage. * Support the monitoring of data pipelines and help troubleshoot data quality issues, pipeline failures, and performance problems. * Follow defined data quality, security, and compliance procedures in regulated environments such as healthcare and financial services. * Collaborate with data analysts, software engineers, and DevOps teams to understand data requirements and upstream systems. * Participate in code reviews, implement feedback, and continuously improve coding and engineering practices. * Create and maintain clear documentation for data pipelines, logic, and operational processes. ## Related Videos - [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works) - [How a Small Team Shrank a Microsoft Monorepo by 94%](https://www.wearedevelopers.com/videos/1236-how-a-small-team-shrank-a-microsoft-monorepo-by-94) - [Shifting Stress to Progress— Understanding DevOps to do DevOps Better](https://www.wearedevelopers.com/videos/268-shifting-stress-to-progress-understanding-devops-to-do-devops-better) - [Modern Data Architectures need Software Engineering](https://www.wearedevelopers.com/videos/1030-modern-data-architectures-need-software-engineering) - [Git for Code Reviews](https://www.wearedevelopers.com/videos/429-git-for-code-reviews) - [From DevOps to Scaled DevOps: How We’re Rebuilding Continuous Delivery as a Platform](https://www.wearedevelopers.com/videos/100018-from-devops-to-scaled-devops-how-we-re-rebuilding-continuous-delivery-as-a-platform) ## Related Articles - [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk) - [What Are The Top Skills Required For Azure Developers?](https://www.wearedevelopers.com/magazine/77-what-are-the-top-skills-required-for-azure-developers) - [The Most Popular IT Jobs on the Market](https://www.wearedevelopers.com/magazine/376-the-most-popular-it-jobs-on-the-market) - [Data Analyst Salary in the UK](https://www.wearedevelopers.com/magazine/278-data-analyst-salary-in-the-uk) - [Top-Paying Tech Jobs (with Salaries)](https://www.wearedevelopers.com/magazine/372-top-paying-tech-jobs-with-salaries) - [The 12 Best Jobs for Software Engineers](https://www.wearedevelopers.com/magazine/401-the-12-best-jobs-for-software-engineers)