Data Engineer (GCP, BigQuery)

Applied Systems
United States
about 1 month ago
Apply on www.indeed.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Experienced
Experience required
3 years minimum
Compensation
$70,000.0 - $120,000.0
Working hours
Regular working hours
Job source

Tech stack

Agile Methodology Artificial Intelligence Confluence JIRA Microsoft Azure Big Data BigQuery Cloud Computing Cloud Database Data as a Services Data Architecture Data Validation
+21 more
Information Engineering Data Governance Data Infrastructure Data Integrity Extract Transform Load (ETL) Data Systems Digital Assets Internet Security Python (Programming Language) Scrum Methodology SQL Databases Google Cloud Data Storage Technologies Snowflake Data Lakes Ansi Sql Information Technology Google Bigquery Data Management Amazon Redshift Databricks

Job description

We’re looking for a Data Engineer to join our AI Engineering - Reporting and Analytics team to build and enhance data solutions and AI initiatives for the business of insurance.

In this role, you will work closely with the Principal Data Architect, Data Scientists, and Software Engineers to build, model, and maintain data solutions as we optimize data architecture and accessibility of large-scale datasets for our global teams.

This position requires the employee to reside and work from one of the following provinces: Alberta, British Columbia, Manitoba, New Brunswick, Newfoundland and Labrador, Nova Scotia, Ontario, PEI, Saskatchewan.

What You’ll Do

  • Code BigQuery procedures, functions, and other database objects by applying expert knowledge in BigQuery SQL and ANSI SQL
  • Implement scalable and efficient data models within our data lake, with a focus on BigQuery
  • Manage and optimize data storage, partitioning, and clustering strategies to ensure high performance and reliability of our data infrastructure
  • Develop and implement features and enhancements in BigQuery, levering your expertise in SQL and cloud-based data warehousing technologies
  • Collaborate with cross-functional teams to understand requirements and deliver solutions aligned with business objectives, security requirements, and guidelines for data governance
  • Develop documentation for the team to support design discussions
  • Ensure data integrity and quality by implementing robust data validation and error-handling mechanisms.
  • Identify and implement improvements across the full lifecycle of data management, from ingestion to ETL processes and final reporting layers, to increase productivity on the team
  • Continuously build knowledge of industry trends and advancements in data engineering and big data technologies, We invest in the whole person, not just the role. Our benefits and resources are built to support your health, your time, and your life outside of work:
  • Medical, Dental, and Vision Coverage
  • Holiday and Vacation Time
  • Health & Wellness Days
  • A Bonus Day for Your Birthday

Compensation Transparency

The total anticipated annual compensation range for this newly created position in Canada includes starting base salary and, where applicable, variable or incentive pay. To determine a new team member’s starting pay, we consider a variety of factors, including someone’s depth, breadth, and variety of experience, skills, and responsibilities.

Your Security Matters: Our candidates’ personal information and online safety are top of mind. Applied communicates with candidates only via a secure @appliedsystems.com email address or through our official careers’ portal. Recruiters will never request payments or ask for financial account or sensitive personal information like Social Security numbers.

AI Utilization

We leverage AI tools to streamline parts of our recruitment workflow (such as resume parsing and interview scheduling). However, final decisions are always conducted by real humans.

Requirements

  • 3+ years of experience in modeling, building, and maintaining data solutions in cloud-based environments
  • Proficiency in SQL and Python to manipulate, store, manage, or retrieve data assets
  • Proven impact with BigQuery and cloud-based data warehousing solutions - Google BigQuery, Snowflake, Amazon Redshift, Microsoft Azure Synapse Analytics, Databricks Lakehouse
  • Experience managing and optimizing BigQuery and Google Cloud Platform data services
  • Knowledge of Agile frameworks, ideally Scrum, and tools like Jira and Confluence
  • Demonstrated analytical and problem-solving skills and detail orientation
  • Bachelor-level degree in Computer Science, MIS, or CIS, or equivalent experience

Talent shows up in a lot of different ways, and we mean that. We welcome candidates from all backgrounds and experience levels, including military members and their spouses and those without a traditional degree or tech background. If this role speaks to you, apply.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.indeed.com
Prepare application

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

2:30 min

Leveraging BigQuery ML for scalable SQL-based segmentation experiments

Julian Joseph · LIVE

3:05 min

Integrating an assistant application with Jira software

Felix Augenstein · LIVE

3:28 min

Defining big data and machine learning fundamentals

Ayon Roy · LIVE

3:09 min

Balancing data science skillings alongside systems engineering rigor

Nico Schmidt · LIVE

3:27 min

Explaining query execution overhead and caching limitations in BigQuery

Adnan Rahic · JS Congress

2:10 min

Why organizations combine big data and machine learning

Ayon Roy · LIVE

Videos

See all

Related articles

See all