Big Data Engineers

Circana, LLC.
Chicago, United States of America
2 days ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English
Experience level
Senior
Compensation
$ 200K

Job location

Remote
Chicago, United States of America

Tech stack

Java
Azure
Big Data
Cloud Computing
Cloudera Impala
Code Review
Information Systems
Computer Engineering
Data Integration
ETL
Data Warehousing
Relational Databases
Linux
Distributed Systems
Hadoop
Hadoop Distributed File System
MapReduce
Hive
Python
PostgreSQL
Oracle Applications
Performance Tuning
Scala
Software Engineering
Software Systems
SQL Databases
System Testing
Scripting (Bash/Python/Go/Ruby)
Spark
PySpark
Apache Flume
Integration Tests
Information Technology
Data Delivery
Databricks

Job description

The Senior Big Data Engineer is responsible for designing, building, and delivering highly scalable big data and ETL solutions across distributed environments. This role supports projects at various and unanticipated client worksites throughout the United States, with headquarters based in Chicago, IL. The engineer works closely with cross-functional teams to develop, test, and deploy data solutions that meet business and operational needs, leveraging modern big data frameworks, cloud platforms, and agile development practices. Telecommuting is permitted., Sr. Big Data Engineers for various and unanticipated worksites throughout the U.S. (HQ: Chicago, IL). Design and implement highly scalable ETL applications on Hadoop and Big Data eco systems. Develop new scripts, tools, and methodologies for streamlining and automating ETL workflows. Deliver big data projects using Spark, Python, Scala, SQL, and Hive. Design and create use-cases and scenarios for functional testing, integration testing, and system testing. Work closely with Data Science, QA, Operations, and other teams to deliver on tight deadlines. Participate in daily agile and scrum meetings and code reviews. Coordinate with cross-functional operational teams for managing data delivery. Write efficient, reusable, and well documented code. Prepare technical design documents for solutions. Identify and address issues encountered from the data factory and provide timely solutions to incorrect or undesired results or behavior with ILD solutions. Technical environment: writing ETL Spark applications in PySpark and Scala, Flume; spark architecture, data frames, tuning spark; relational databases (Oracle, PostgreSQL); Python, SQL HQL, Hive; Data Bricks; managing software systems using Hadoop, MapReduce, HDFS and all included services; distributed computing principles; Big Data querying tools (Pig, Hive, Impala); data-warehousing and data-modeling techniques; Core Java, Linux, SQL, scripting languages; Cloud platforms (Azure); integration of data from multiple data sources; Lambda Architecture.

Requirements

Bachelor's degree in Computer Science or Information Systems or Computer Engineering or any Engineering or related field plus 5 years of progressive experience as a Software Engineer/Developer or in Software Development required. Required Skills: experience writing ETL Spark applications in PySpark or Scala; spark architecture, data frames, tuning spark; relational databases (Oracle, PostgreSQL); Python, SQL HQL, Hive; Data Bricks; managing software systems using Hadoop, MapReduce, HDFS and all included services; experience with distributed computing principles; Big Data querying tools (Hive); data-warehousing & data-modeling techniques; Core Java, Linux, SQL, scripting languages; Cloud platforms (Azure); integration of data from multiple data sources; Lambda Architecture. Telecommuting permitted. (*Will also accept 4 years of university study in Computer Science or Information Systems or Computer Engineer plus 7 years of progressive experience as a Software Engineer/Developer or in software development in lieu of Bachelor's degree plus 5 years of progressive experience as a software Engineer/Developer or in software development.) Circana Behaviors Beyond technical skills, experience, and role-specific attributes, these shared behaviors are fundamental to our culture and success. We seek individuals who consistently demonstrate and champion these behaviors in their daily work

Benefits & conditions

  • Stay Curious: Being hungry to learn and grow, always asking the big questions.
  • Seek Clarity: Embracing complexity to create clarity and inspire action.
  • Own the Outcome: Being accountable for decisions and taking ownership of our choices.
  • Center on the Client: Relentlessly adding value for our customers.
  • Be a Challenger: Never complacent, always striving for continuous improvement.
  • Champion Inclusivity: Fostering trust in relationships engaging with empathy, respect, and integrity.
  • Commit to each other: Contributing to making Circana a great place to work for everyone., The below range reflects the range of possible compensation for this role at the time of this posting. We may ultimately pay more or less than the posted range. This range may be modified in the future. An employee's position within the salary range will be based on several factors including, but not limited to, relevant education, qualifications, certifications, experience, skills, seniority, geographic location, performance, shift, travel requirements, sales or revenue-based metrics, any collective bargaining agreements, and business or organizational needs. The salary range for this role is 160,500 USD to $200,000 USD.

This job is also eligible for bonus pay.

We offer a comprehensive package of benefits including paid time off, medical/dental/vision insurance and 401(k) to eligible employees., Remote 5 Locations 185K-300K Annually Senior level 185K-300K Annually Senior level Greentech * Hardware * Internet of Things * Machine Learning * Software * Business Intelligence * Agriculture Lead and coach a regional field sales team of Territory Managers with ~60% travel. Own regional revenue, pipeline hygiene, forecasting in Salesforce, recruit and develop talent, surface customer insights to cross-functional teams, and translate national strategy into regional execution. Top Skills: Salesforce Halter, Remote 3 Locations 185K-300K Annually Senior level 185K-300K Annually Senior level Greentech * Hardware * Internet of Things * Machine Learning * Software * Business Intelligence * Agriculture Lead and coach Territory Managers across the Desert Southwest through frequent fieldwork (~60% travel). Drive regional revenue, maintain Salesforce pipeline and forecasting rigor, support deal execution, localize national strategy, recruit and scale the team, and surface customer insights to cross-functional teams. Focus on hands-on sales leadership, consistent execution, and building high-performing culture in a fast-growth hardware+software environment. Top Skills: CRMSalesforce Halter, Remote 2 Locations 200K-273K Annually Senior level 200K-273K Annually Senior level Greentech * Hardware * Internet of Things * Machine Learning * Software * Business Intelligence * Agriculture Lead and coach Territory Managers through frequent field work (~60% travel), drive regional revenue and pipeline hygiene, maintain Salesforce forecasting, localize national strategy, recruit and develop talent, and surface customer insights to cross-functional teams. Top Skills: Salesforce

What you need to know about the Colorado Tech Scene

With a business-friendly climate and research universities like CU Boulder and Colorado State, Colorado has made a name for itself as a startup ecosystem. The state boasts a skilled workforce and high quality of life thanks to its affordable housing, vibrant cultural scene and unparalleled opportunities for outdoor recreation. Colorado is also home to the National Renewable Energy Laboratory, helping cement its status as a hub for renewable energy innovation.

Key Facts About Colorado Tech

  • Number of Tech Workers: 260,000; 8.5% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Lockheed Martin, Century Link, Comcast, BAE Systems, Level 3
  • Key Industries: Software, artificial intelligence, aerospace, e-commerce, fintech, healthtech
  • Funding Landscape: $4.9 billion in VC funding in 2024 (Pitchbook)
  • Notable Investors: Access Venture Partners, Ridgeline Ventures, Techstars, Blackhorn Ventures
  • Research Centers and Universities: Colorado School of Mines, University of Colorado Boulder, University of Denver, Colorado State University, Mesa Laboratory, Space Science Institute, National Center for Atmospheric Research, National Renewable Energy Laboratory, Gottlieb Institute

About the company

Circana is a leading provider of technology, AI, and data solutions for consumer-packaged goods companies, manufacturers, and retailers. Our predictive analytics and Liquid Data® platform help clients measure market share, uncover consumer behavior, and drive growth-powered by six decades of expertise and an expansive, high-quality data set. At Circana, we are fueled by our passion for continuous learning and growth, we seek and share feedback freely, and we celebrate victories both big and small in an environment that is flexible and accommodating to our work and personal lives. We're a global company dedicated to fostering inclusivity and belonging. We value and celebrate the unique experiences, cultures, and viewpoints that each individual brings. By embracing a wide range of backgrounds, skills, expertise, and beyond, we create a stronger, more innovative environment for our employees, clients, and communities. With us, you can always bring your full self to work. Join our inclusive, committed team to be a challenger, own outcomes, and stay curious together. Circana is proud to be Certified by Great Place To Work®. This prestigious award is based entirely on what current employees say about their experience working at Circana. Learn more at www.circana.com.

Apply for this position