> Markdown version of [/jobs/ext/2847514-data-engineer-oesis-framework](https://www.wearedevelopers.com/jobs/ext/2847514-data-engineer-oesis-framework). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Data Engineer - OESIS Framework - **Company:** OPSWAT INC - **Location:** United States - **Experience:** Experienced - **Contract:** Permanent contract - **Skills:** Application Programming Interfaces (APIs), Airflow, Data Deduplication, Information Engineering, Extract Transform Load (ETL), Data Structures, Python (Programming Language), PostgreSQL, MySQL, NoSQL, PCI Data Security Standards, Zero Trust Network Access, Standard Sql, Data Ingestion, Microsoft InTune, Falcon Platform, Patch Management, Apache Kafka, Casper Suite, Restful APIs, Pagination, Data Pipelines, Web Api - **Published:** September 11, 2026 - **Apply:** https://www.thejobnetwork.com/job/f0c9f967-ded1-4af6-abf1-f1fbbe787c91/data-engineer-oesis-framework ## About the Role - 3+ years in data engineering: ETL/ELT pipeline design, data modeling, and large-scale ingestion - Strong SQL plus hands-on experience with both relational (Postgres/MySQL) and NoSQL or columnar stores - Experience with pipeline orchestration tools (Airflow, Dagster, Prefect) and/or streaming platforms (Kafka, Kinesis) - Direct experience handling REST API pagination, bulk/batch queries, and rate-limited data collection at scale - Demonstrated experience normalizing heterogeneous schemas from multiple external data sources into one model - Strong Python (or equivalent) for pipeline development - Understanding of multi-tenant data isolation and relevant compliance requirements (SOC 2, GDPR) , - Prior experience specifically with security or compliance data (device posture and regulatory compliance (PCI-DSS, SOX, HIPPA, etc.), vulnerability, patch management) - Experience with time-series or event-driven data models for compliance state changes - Direct familiarity with CrowdStrike, Intune, or JAMF data structures and cloud based device management frameworks - Familiarity with Zero Trust Network Access (ZTNA) and device posture or compliance ## Description - Build scalable ingestion pipelines that query large volumes of device/compliance data from Endpoint Device Management Platforms (such as CrowdStrike, Intune, JAMF) both full bulk syncs and incremental/delta syncs - Design a normalized compliance data schema that maps each vendor's distinct data model (e.g., CrowdStrike host/device telemetry, Intune compliance policy state, JAMF inventory records) into one common internal representation - Build and tune the storage layer (relational, NoSQL, or warehouse) for high-volume, multi-tenant compliance data with efficient read/query patterns for downstream consumers - Implement caching, deduplication, and delta-sync logic that minimizes redundant API calls and respects each vendor's rate limits and query quotas - Build ETL/ELT orchestration for scheduled and event-driven syncs, with monitoring and alerting on pipeline health and sync failures - Partner with the Integration Engineer on the shape of the raw API responses being handed off, and with the Auth Engineer to handle token expiry gracefully mid-query , business needs without regard to race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other category protected by federal, state, or local laws. Recruiting Agencies: we do not accept unsolicited resumes from third party agencies for any of our open positions. To submit resumes for our jobs, there must be a recruiting contract approved by our legal team and endorsed by both parties. We are currently not accepting additional 3rd party agencies at this time. ## Related Videos - [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works) - [MySQL Protocol Features You Should Be Aware Of](https://www.wearedevelopers.com/videos/100267-mysql-protocol-features-you-should-be-aware-of) - [Leveraging Real time data in FSIs](https://www.wearedevelopers.com/videos/806-leveraging-real-time-data-in-fsis) - [Security Pitfalls for Software Engineers](https://www.wearedevelopers.com/videos/726-security-pitfalls-for-software-engineers) - [Enjoying SQL data pipelines with dbt](https://www.wearedevelopers.com/videos/823-enjoying-sql-data-pipelines-with-dbt) - [AI Model Management Life Circles: ML Ops For Generative AI Models From Research to Deployment](https://www.wearedevelopers.com/videos/1152-ai-model-management-life-circles-ml-ops-for-generative-ai-models-from-research-to-deployment) ## Related Articles - [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers) - [How We Built a Worry-Free System That Runs for 10+ Years – And What We’d Do Again](https://www.wearedevelopers.com/magazine/751-how-we-built-a-worry-free-system-that-runs-for-10-years-and-what-we-d-do-again) - [Is Software Engineering Over-Saturated?](https://www.wearedevelopers.com/magazine/418-is-software-engineering-over-saturated) - [Dev Digest 134 - Where pixels sing?](https://www.wearedevelopers.com/magazine/477-dev-digest-134-where-pixels-sing) - [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know) - [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story)