> Markdown version of [/jobs/ext/2861514-data-engineer](https://www.wearedevelopers.com/jobs/ext/2861514-data-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Data Engineer - **Company:** American College Of Physicians - **Location:** Philadelphia, PA, United States - **Experience:** Experienced - **Contract:** Permanent contract - **Skills:** Agile Methodology, Amazon Web Services, Systems Engineering, ARM Architecture, Microsoft Azure, Information Engineering, Extract Transform Load (ETL), Data Transformation, Data Systems, Python (Programming Language), Software Engineering, SQL Databases, Data Streaming, Systems Architecture, Cloud Platform System, Snowflake, Change Tracking, Information Technology, Apache Kafka, Data Management, Data Lakehouse, Api Design, Software Coding, Data Pipelines - **Published:** September 12, 2026 - **Apply:** https://www.indeed.com/viewjob?jk=05acb90b3711f992 ## About the Role * A Bachelor's degree is required, preferably in Computer Science, Software Engineering, Systems Engineering, Data Science, or another field closely related to data engineering. * Demonstrable experience with the Snowflake platform and related tooling, e.g., dbt and Fivetran, is required. Currency in the evolution of Cortex Code (CoCo) and Semantic Views is highly desirable. * At least 3 years of experience designing and developing data pipelines in modern data engineering environments is required. Experience working with large-scale (1M+ records) customer and behavioral data models and systems, e.g., "Customer 360" models highly desirable. * Experience with multiple techniques for modeling and transformations, e.g., ETL, reverse ETL, and modern ELT techniques/platforms, as well as real-time/streaming processes, e.g., Apache Kafka. * Strong understanding of all stages of integrated, data lakehouse-oriented architectures, from ingestion to semantic modeling to delivery/activation. * Deep experience with core data engineering coding techniques/languages: SQL, Python. * Experience working within multiple large-scale API-based, cloud architectures, e.g., Amazon AWS-based and Microsoft Azure-based is highly preferred. * Excellent oral and written communication skills are essential to interact with all levels of College staff, members, and external resources in both group and one-on-one settings. ## Description The Data Engineer will provide technical leadership responsibility for building and managing enterprise-wide data transformation and orchestration processes and data pipelines. This work will require expertise in several layers of our enterprise data infrastructure, including our diverse source systems, our medallion-modeled data lakehouse, data activation platforms, and the orchestration and transformation of data as it flows throughout the entire data estate. Responsibilities include but are not limited to: * Provides technical leadership in data pipeline design and development organization-wide, ensuring data flows are orchestrated in alignment with business needs and system architectures. Emphasis will be on ingestion, unifying transformations, and deliveries to activation platforms via the data lakehouse. * Ensures that designs and techniques are compliant with system architectures as well as data management and governance standards and policies in place within the organization. * Uses agile software development processes, in collaboration and alignment with the development, analyst, and data administration teams, to make iterative deployments with full visibility and change tracking. * Ensures documentation of data models, transformations, and orchestration remain current, comprehensive, semantically precise, and accessible to all staff. * Partners with others across the data management team to collaborate with business stakeholders, ensuring that pipelines are optimized for quality, reliability, contextual accuracy, and actionability. * Plays a key role in enterprise data architecture design and analysis, including interactions with consultants and contractors. * Monitors data systems and flows, utilizing automated tooling to ensure successful and reliable pipelines. ## Related Videos - [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works) - [How Cisco embraced a DevOps culture within its network engineering team](https://www.wearedevelopers.com/videos/99-how-cisco-embraced-a-devops-culture-within-its-network-engineering-team) - [API Design - Getting Started](https://www.wearedevelopers.com/videos/33-api-design-getting-started) - [How to Benchmark Your Apache Kafka](https://www.wearedevelopers.com/videos/76-how-to-benchmark-your-apache-kafka) - [Hacking AI at the Edge of the Indian Ocean](https://www.wearedevelopers.com/videos/100177-hacking-ai-at-the-edge-of-the-indian-ocean) - [Modern Data Architectures need Software Engineering](https://www.wearedevelopers.com/videos/1030-modern-data-architectures-need-software-engineering) ## Related Articles - [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story) - [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers) - [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk) - [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know) - [How We Built a Worry-Free System That Runs for 10+ Years – And What We’d Do Again](https://www.wearedevelopers.com/magazine/751-how-we-built-a-worry-free-system-that-runs-for-10-years-and-what-we-d-do-again) - [What Are The Top Skills Required For Azure Developers?](https://www.wearedevelopers.com/magazine/77-what-are-the-top-skills-required-for-azure-developers)