Data Engineer
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Tech stack
+20 more
Job description
Software Guidance & Assistance, Inc., (SGA), is searching for a Data Engineer for a CONTRACT assignment with one of our premier SaaS clients in Austin, TX., Adobe Commerce is in the middle of a major business transition from PaaS to SaaS (ACCS and ACO). Leadership needs clean, reliable, and timely data to power decisions about which customers to migrate, how to protect margin, and where to focus product and engineering effort. The Data Engineer is the person who makes that possible. This role owns the Commerce data infrastructure - building and maintaining the pipelines, models, and systems that move raw data from source systems into trusted, production-grade datasets., * Design, build, and maintain data pipelines ingesting from Salesforce, Dynamics, Platform.sh, Snowplow, and cloud vendor sources
- Develop and optimize ETL/ELT workflows using Python and PySpark for large-scale batch and incremental processing
- Build and maintain data models (fact/dimension tables) for customers, deals, margin, usage, and migration data
- Partner with Analytics and BI teams to ensure pipeline outputs meet their modeling and reporting needs
- Ensure Data Reliability at Scale
- Own data quality, validation, and monitoring across ingestion and transformation layers
- Design for scalability, fault tolerance, and performance across growing data volumes
- Build orchestration, alerting, and error-handling into pipelines to catch issues before they reach downstream consumers
- Manage schema evolution, versioning, and backfills as source systems and business needs change
- Enable the Business Through Solid Data Foundations
- Translate data requirements from Analytics, Finance, Product, and Engineering into robust pipeline and schema designs
- Ensure data is accurate, timely, and well-documented so downstream teams can trust it without re-validating it themselves
- Support pre- and post-launch data needs for ACCS and ACO by ensuring the right raw and modeled data is available and correct
- What Success Looks Like
- Pipelines run reliably, on schedule, with clear alerting when something breaks
- Downstream teams trust the data without needing to double-check it
- New data sources and schema changes are onboarded quickly and cleanly
- Data infrastructure scales smoothly as Commerce’s data volume and complexity grow
- Commerce operates from a single, well-engineered data foundation instead of fragmented, ad hoc pipelines
Requirements
- Strong software/data engineering skills with a focus on building scalable, production-grade pipelines
- Experience ingesting and transforming data from CRM, product, and financial systems
- Ability to design data models and schemas that serve multiple downstream consumers
- Comfortable working with Analytics, Finance, Product, and Engineering to understand data requirements
- A mindset focused on reliability, scalability, and correctness - not dashboards or business analysis
- Proficient in English (verbal/written)
- Advanced data engineering with a strong focus on building scalable, reliable pipelines that power downstream analytics and reporting
- Expert in data pipeline architecture, performance tuning, and designing fact and dimension tables for customer, usage, contract, and financial data
- Hands-on experience developing Python and PySpark ETL/ELT workflows for large-scale data ingestion, transformation, and validation
- Hands-on experience with building PowerBI reports
- Technical capabilities:
- Reporting: PowerBI experience
- Data Warehousing & Databases: Amazon Redshift, Snowflake, SQL-based data stores
- ETL & Data Pipelines: AWS Glue, PySpark, Python-based batch and incremental pipelines, orchestration tools
- Cloud Platforms: AWS, Azure, Google Cloud Platform
- Programming & Query Languages: Python, PySpar
About the company
SGA is a technology and resource solutions provider driven to stand out. We are a women-owned business. Our mission: to solve big IT problems with a more personal, boutique approach. Each year, we match consultants like you to more than 1,000 engagements. When we say let’s work better together, we mean it. You’ll join a diverse team built on these core values: customer service, employee development, and quality and integrity in everything we do. Be yourself, love what you do and find your passion at work. Please find us at .
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Good distractions
Talks and stories from around this role — technically off-topic, practically not.
Moments
Explore playlistsVideos
See allRelated articles
See all
Making Data Warehouses Fast: A Developer’s Story
Highest Paying Tech Companies for Developers
Data Analyst Salary in the UK
Top Big Data Technologies That You Need to Know