Data Engineer
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Tech stack
+25 more
Job description
The Data Engineer is responsible for the integration build, data pipeline construction and operations, connector implementation, ETL development, and Astreya proprietary data pipeline operations that underpin Astreya’s Intelligence Suite deployment at a strategic enterprise technology client. Working under the technical direction of the Forward Deployed Engineer and alongside the Technical Project Manager, this individual executes the integration builds that the FDE architects - enabling the FDE to focus on platform governance, AI Agent design, and client IT engagement. The Data Engineer is also the operational owner of all live data pipelines throughout the engagement term., * Build and validate all T1 and T2 connector integrations per the architecture specifications in the Enterprise Architecture Document and FSD; execute integration builds per FDE direction.
- Construct and operate data pipelines: source connection, transformation logic, normalization rule implementation, DQ check configuration, and dashboard data feed maintenance; own the operational reliability of all data pipelines throughout the SOW term.
- Build and maintain ETL jobs for all confirmed T1/T2/T3 connector sources; handle schema changes, API version updates, and data quality remediation as they arise in production.
- Implement MCP server configurations under the FDE’s technical direction; build and test MCP endpoint integrations that enable AI agents to access client operational systems in real time.
- Support the Technical PM on FSD Section 5 (technical integration specifications): provide implementation-level detail, document field mappings, normalization rules, and data flow specifications for each connector built.
- Maintain data flow planograms as a living technical record; update planograms whenever a connector is modified, a normalization rule changes, a schema mapping is revised, or a new integration is added.
- Assess new connector requests per the LOE threshold framework; provide effort estimates to the Technical PM within five business days of any connector request.
- Post Day 90, transition from foundation build to live platform operations; own production data pipeline reliability, data quality monitoring, and Routine connector builds as the client requests new data connections.
- Onboard and train incoming Data Engineers and BI Developers as they are activated via Change Order; ensure continuity of pipeline operational standards and FSD compliance.
Requirements
- 4-7 years of experience in data engineering, ETL development, or enterprise systems integration.
- Proficiency building and operating data pipelines at scale using modern ETL frameworks and tools.
- Hands-on experience with SAP integration methods (BAPI for ECC and/or OData for S/4HANA); experience integrating with SD, QM, and BW modules preferred.
- Strong proficiency with REST API integrations, OAuth2 authentication, and field mapping/normalization implementation.
- Experience building and maintaining data quality check frameworks; ability to remediate schema variance, missing fields, and encoding issues in production pipelines.
- Familiarity with EDI (X12/AS2) data ingestion and carrier milestone event normalization.
- Ability to produce and maintain data flow documentation (planograms, data dictionaries, field mapping registers).
- Proficiency with at least one cloud data platform (AWS, Google Cloud Platform, or Azure) and associated data pipeline tooling.
- Bachelor’s degree in Computer Science, Information Systems, Data Engineering, or a related field; or equivalent professional experience., * Experience with MCP (Model Context Protocol) server configuration and AI agent real-time data access integration.
- Background in Salesforce (SFDC) REST/Bulk API 2.0 data pipeline construction.
- Familiarity with IoT data stream ingestion and real-time event processing.
- Experience integrating with Power BI REST API and/or embedded BI data feed architectures.
- Knowledge of data normalization requirements for multi-region, multi-timezone operational data sets (UTC standardization, currency normalization, carrier name resolution).
Benefits & conditions
$85,120.00 - $134,400.00 USD (Salary)
- Please note that the salary information provided herein is base pay only (gross); it does not include other forms of compensation which may or may not apply to this specific position, namely, performance-based bonuses, benefits-related payments, or other general incentives - none of which are guaranteed, may be subject to specific eligibility requirements, and are wholly within the discretion of Astreya to remit.
- Further, the salary information noted above is a range that consists of a minimum and maximum rate of pay for this specific position. Where an applicant or employee is placed on this range will depend and be contingent on objective, documented work-related considerations like education, experience, certifications, licenses, preferred qualifications, among other factors.
Astreya offers comprehensive benefits to all Regular, Full-Time Employees, including:
- Medical provided through UHC (PPO, HSA, Surest options) / Medical provided through Kaiser (HMO option only) for California employees only
- Dental provided through UHC
- Nationwide Vision provided by UHC
- Flexible Spending Account for Health & Dependent Care
- Pre-Tax Account for Commuter Benefit/Parking & Transit (location-specific)
- Continuing Education and Professional Development via various integrated platforms, e.g. Udemy and Coursera
- Corporate Wellness Program provided by Goomi Group
- Employee Assistance Program
-
Wellness Days 401k Plan
- Basic and Supplemental Life Insurance
- Short Term & Long Term Disability
- Critical Illness, Critical Hospital, and Voluntary Accident Insurance
- Tuition Reimbursement (available 6 months after start date, capped)
- Paid Time Off (accrued and prorated, maximum of 120 hours annually)
- Paid Holidays
- Any other statutory leaves, paid time, or other ancillary benefits required under state and federal law
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Apply on dice.comGood distractions
Talks and stories from around this role — technically off-topic, practically not.
Moments
Explore playlistsVideos
See allRelated articles
See all
Top-Paying Tech Jobs (with Salaries)
Data Engineer Salary UK
Making Data Warehouses Fast: A Developer’s Story
The Most Popular IT Jobs on the Market