Staff Data Engineer-GCP/Data Solutions (San Antonio, Austin or Dallas) job in Austin
Role details
Job location
Tech stack
Job description
As a Staff Data Engineer, you'll use an advanced analytical, data-driven approach to drive a deep understanding of our fast-changing business and answer real world questions. You'll work with stakeholders to develop a clear understanding of data and data infrastructure needs, resolve complex data-related technical issues, and ensure optimal data design and efficiency.
Once you're eligible, you'll become an Owner in the company, so we're looking for commitment, hard work, and focus on quality and Customer service. 'Partner-owned' means our most important resourcesPeopledrive the innovation, growth, and success that make H-E-B The Greatest Omnichannel Retailing Company.
Do you have a: HEART FOR PEOPLE... you're willing to facilitate solutions with multiple engineers, provide upward communication, and mentor others? HEAD FOR BUSINESS... you consistently demonstrate and uphold the standards of coding, infrastructure, and process? PASSION FOR RESULTS... you're capable of high-velocity contributions in multiple technical domains?
We are looking for:
- 8+ years of experience related to data engineering
What is the work? &bull Designs data patterns that support creation of datasets for analytics implements calculations, cleanses data, ensures standardization of data, maps / links data from more than one source &bull Performs data validation and quality assurance on work of senior peers and write automated tests &bull Maintains / streamlines / orchestrates existing data pipelines end to end &bull Builds / supports complex data warehousing pipelines into cloud platforms GCP/AWS, data integrations, data streaming solutions, predictive model implementations with prompt engineering for AI Models, building out data quality checks into data pipelines that are on BigQuery or Databricks &bull Works with peer staff engineers to perform design reviews and swiftly change patterns according to latest tools and technologies &bull Designs and develops real-time streaming requirements by using structured streaming from either pub-sub or another streaming table on datalake &bull Builds / supports more complex data pipelines including application programming interfaces (APIs) &bull Identifies complex data from upstream sources to enable new capabilities. &bull Engages in testing of the technical solutions to ensure data integrity and system functionality of own work and broader system, E2E &bull Builds large-scale batch and real-time data pipelines with big data CDC processing frameworks &bull Designs / develops data integrations to support application engineering and system integration &bull Designs / develops / maintains large data pipelines diagnoses / solves production support issues &bull Creates documentation and training related to technology stacks and standards within assigned team &bull Designs / implements monitoring capabilities based on business SLA and data quality &bull Uses / contributes to refinement of Digital Engineering-related tools, standards, and training &bull Engages / collaborates with external technical teams to ensure timely, high-quality solutions &bull Engages with shared services teams and vendors when necessary &bull Works closely with Product, Data Science, Application, and Analytics teams to develop a clear understanding of data and data infrastructure needs assists with data-related technical issues ensures optimal data design and efficiency &bull Performs full SDLC process, including planning, design, development, certification, implementation, and support &bull Interacts with Product, Business, Analyst stakeholders to confirm data quality, discuss requirements, and support data testing &bull Peer reviews with team members learns / adapts from peer review of own code &bull Contributes to overall design, architecture, security, scalability, reliability, and performance &bull Mentors / provides support to Senior Data Engineers &bull Builds more complex data models to deliver insightful analytics ensures highest standard in data integrity &bull Has knowledge in machine learning concepts
Requirements
&bull A related degree or work experience, preferably a Bachelors degree in related work stream &bull 8+ years of experience related to data engineering &bull Experience in Lean Startup or Agile development methodologies &bull Experience working in large scale cloud infrastructure, large data sets, and mission critical SLAs &bull Experience in Advanced SQL / Python. &bull Have a data engineering certification from any of the cloud technologies
Do you have what it takes to be an H-E-B Staff Data Engineer? &bull Advanced knowledge of Lean Startup / Agile methods &bull Strong understanding business intelligence, analytics and reporting, and application integration &bull Knowledge of data architectures such as data warehouse, data lake, and data mesh and when to apply &bull Strong working understanding of data architecture and data modeling best practices and guidelines for various data and analytic platforms &bull Strong working understanding of coding standards and design principles / patterns &bull Strong prioritization skills &bull Strong verbal / written communication and data presentation skills &bull Ability to deliver on ambiguous projects with incomplete information &bull Ability / willingness to learn new technologies as they emerge &bull Ability to calmly work under pressure &bull Ability to work a flexible schedule as needed &bull Ability to collaborate across multiple teams at multiple work locations &bull Ability to work within a team, and willingness to take feedback from peers and mentors
Can you... &bull Function in a fast-paced environment with the ability to work from home and / or office &bull Work extended hours sit for extended periods