Big Data Engineer
Role details
Job location
Tech stack
Job description
Project is building the data modeling and data infrastructure that will feed into a pricing model. Ingesting raw data, building series of models, handing off to Economics team that will put into pricing model for refined fuels. We are seeking a Big Data Engineer to join our Data Engineering team and help deliver scalable, governed, and business-aligned data products across the enterprise. The ideal candidate will have experience partnering with business stakeholders, analysts, data scientists, product owners, and technology teams to collect requirements, define business analytics needs, and translate those findings into product development and data architecture decisions. This role requires someone who can understand business processes, ask strong questions to confirm business rules, and convert requirements into reliable data pipelines, data models, and consumption-ready assets. Key Responsibilities Partner with business and technical stakeholders to gather requirements, define analytics needs, and transform source system data. Translate business requirements into scalable data models, pipeline logic, transformation patterns, and architecture decisions. Design, build, test, deploy, and maintain data pipelines across Snowflake, AWS, Microsoft, and related enterprise platforms. Develop governed data products that support reporting, analytics, data science, automation, and business decision-making. Build and maintain data models and transformations using SQL, Python, dbt, Snowflake, and modern data engineering practices. Collaborate with DevOps, architecture, security, analytics, and business teams to move solutions into production. Apply development standards including version control, code review, testing, documentation, and CI/CD. Support data governance practices including RBAC, access controls, naming standards, lineage, and data quality expectations. Identify opportunities to automate manual processes, improve data delivery, optimize performance, and reduce operational risk. Troubleshoot pipeline failures, data quality issues, access issues, and performance bottlenecks. Support migration and decommissioning of legacy platforms, reports, and manual data processes. Collaborate with analysts and data scientists to convert recurring ad hoc analysis into scalable data delivery solutions. Embody a culture of ownership, continuous improvement, documentation, innovation, and learning.
Requirements
Bachelor's degree in Computer Science, Information Technology, Management Information Systems, Engineering, Mathematics, or a related field. 3+ years of experience in data engineering, analytics engineering, business intelligence engineering, software engineering, or a related technical role. Strong SQL and Python skills with experience building, optimizing, and supporting data transformations or data pipelines. Experience developing data pipelines, ETL/ELT processes, data models, or analytics-ready datasets. Experience with Snowflake and dbt in a production data environment. Experience with cloud data platforms and services such as AWS, Microsoft Azure, or similar technologies. Experience translating business requirements into technical solutions. Strong analytical, problem-solving, communication, and documentation skills. Ability to work independently while collaborating effectively in a team environment.
Preferred Qualifications Experience with Azure DevOps, Git, CI/CD, APIs, AWS Lambda, S3, Octopus Deploy, Power BI, or related tools. Experience with governed data environments, RBAC, secure data access, data sharing, or enterprise data governance. Experience supporting medallion architecture, data products, domain-oriented data ownership, or self-service analytics. Experience working with analysts, data scientists, product teams, DevOps teams, enterprise architects, and business stakeholders. Experience in agriculture, energy, supply chain, logistics, trading, hedging, finance, or operations data domains. Experience Level Expert Level
Benefits & conditions
This is a Contract position based out of Minneapolis, MN. Pay and Benefits The pay range for this position is $80.00 - $100.00/hr. Eligibility requirements apply to some benefits and may depend on your job classification and length of employment. Benefits are subject to change and may be subject to specific elections, plan, or program terms. If eligible, the benefits available for this temporary role may include the following: Medical, dental & vision Critical Illness, Accident, and Hospital 401(k) Retirement Plan - Pre-tax and Roth post-tax contributions available Life Insurance (Voluntary Life & AD&D for the employee and dependents) Short and long-term disability Health Spending Account (HSA) Transportation benefits Employee Assistance Program Time Off/Leave (PTO, Vacation or Sick Leave) Workplace Type This is a fully remote position.