Senior Data Engineer, AWS Data Platform

IDEXX
Westbrook, ME, United States
10 days ago
Apply on www.adzuna.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
3 years minimum
Compensation
$110,000.0 - $130,000.0
Working hours
Regular working hours
Job source

Tech stack

Application Programming Interfaces (APIs) Amazon Web Services Amazon S3 Databases Information Engineering Data Systems Software Debugging Distributed Data Store Amazon DynamoDB Fault Tolerance Identity and Access Management JSON
+24 more
Python (Programming Language) Laboratory Information Management Systems Operational Data Store Operational Databases Shell Script Amazon Simple Notification Service (SNS) SQL Databases Data Streaming Extensible Markup Language (XML) Data Ingestion Apache Spark Electronic Medical Records Cloudformation Data Lakes Information Technology AWS Data Analytics Data Delivery Api Design Api Gateway Restful APIs Amazon Simple Queue Service (SQS) Data Pipelines Jenkins Databricks

Job description

  • Build and maintain streaming ingestion, API-based data workflows, and distributed data transformations using AWS services (Kinesis, Lambda, Glue/Spark, EMR, S3)
  • Develop and maintain REST APIs for data ingestion and consumption
  • Design and implement platform automation and standardized, repeatable deployment mechanisms (e.g., versioned releases, environment promotion, and deterministic deployment workflows)
  • Develop and optimize data lake and operational data models for near-real-time use cases
  • Work across both streaming (operational) and batch (analytical) layers to ensure consistent, high-quality data delivery
  • Help improve reliability, automation, and observability across the RDE data platform
  • Participate in an on-call rotation to help provide support for the team’s data systems and services

Requirements

We are seeking a highly motivated and experienced Senior Data Engineer to join our IT Data Engineering team and support the accelerated advancement of IDEXX’s global LIMS (Lab Information Management System) program initiatives. This role is pivotal in developing and maintaining the data systems and infrastructure that deliver diagnostic results to our customers in near-real-time. This is not a SQL/ELT or Databricks-notebook-driven role; candidates must have experience building production data systems and services end-to-end, including CI/CD pipelines and IaC. This role centers on operational, near-real-time data pipelines, streaming ingestion, AWS-native compute, and API-driven data flows (using Kinesis, Glue/Spark, Lambda, and related services)., * 4+ years of experience building, operating, and supporting production-grade data systems and services in highly reliable, fault-tolerant environments

  • 3+ years of hands-on experience designing and developing solutions on AWS, including services such as Lambda, Glue, Kinesis, EMR, S3, SNS, SQS, DynamoDB, API Gateway, and IAM
  • Strong proficiency in Python and experience with shell scripting
  • Experience troubleshooting, debugging, and optimizing distributed data systems, including streaming pipelines, Spark workloads, APIs, messaging queues, and storage layers
  • Experience designing, building, and maintaining RESTful APIs
  • Experience implementing Infrastructure as Code using Terraform and/or CloudFormation
  • Experience building CI/CD pipelines and automated testing frameworks using tools such as Jenkins
  • Knowledge of relational, document, and key-value database technologies
  • Experience working with semi-structured event data (JSON, XML) and evolving data schemas
  • Bachelor’s degree in Computer Science, Information Technology, Engineering, or equivalent combination of education and practical experience

Benefits & conditions

  • Base annual salary target: $110000 - $130000 (yes, we do have flexibility if needed)
  • Opportunity for annual cash bonus
  • Health / Dental / Vision Benefits Day-One
  • 5% matching 401k
  • Additional benefits including but not limited to financial support, pet insurance, mental health resources, volunteer paid days off, employee stock program, foundation donation matching, and much more!

Why IDEXX?

We’re proud of the work we do, because our work matters. An innovation leader in every industry we serve, we follow our Purpose and Guiding Principles to help pet owners worldwide keep their companion animals healthy and happy, to ensure safe drinking water for billions, and to help farmers protect livestock and poultry from diseases. We have customers in over 175 countries and a global workforce of over 10,000 talented people.

So, what does that mean for you? We enrich the livelihoods of our employees with a positive and respectful work culture that embraces challenges and encourages learning and discovery. At IDEXX, you will be supported by competitive compensation, incentives, and benefits while enjoying purposeful work that drives improvement. Did we mention that we are a dog-friendly office?

IDEXX values a diverse workforce and workplace and strongly encourages women, people of color, LGBTQ+ individuals, people with disabilities, members of ethnic minorities, foreign-born residents, and veterans to apply.

IDEXX is an equal opportunity employer. Applicants will not be discriminated against because of race, color, creed, sex, sexual orientation, gender identity or expression, age, religion, national origin, citizenship status, disability, ancestry, marital status, veteran status, medical condition, or any protected category prohibited by local, state, or federal laws.

Let’s pursue what matters together.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.adzuna.com
Prepare application

Good distractions

Loading talks and stories from around this role…