Data Engineer

Kforce Inc.
Maryland Heights, MO, United States
about 1 month ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Working hours
Regular working hours
Job source

Tech stack

Big Data Data Validation Extract Transform Load (ETL) Database Development Apache Hadoop Python (Programming Language) MongoDB Operational Databases Standard Sql Data Streaming Data Ingestion Apache Spark
+4 more
Apache Kafka Apache Nifi Splunk Data Pipelines

Job description

Kforce is seeking a Senior Data Engineer for a client in Maryland Heights, MO working 4 days in office. Overview: This role is focused on ETL/data pipeline development and support. The ideal candidate will have strong Python skills and experience building, maintaining, troubleshooting, and optimizing data pipelines. Experience with Apache NiFi is highly preferred, but candidates with other enterprise ETL platforms are welcome. Responsibilities:

  • Build and maintain data ingestion and ETL pipelines
  • Create new data flows and enhance existing pipelines
  • Consume data from Kafka and load/process it into MongoDB
  • Write and modify Splunk queries for monitoring and analysis
  • Perform data validation and data quality checks
  • Troubleshoot pipeline failures and performance issues
  • Refine and optimize existing pipelines
  • Support operational issues and production incidents
  • Occasionally assist with SQL development, table creation, and data investigations as needed

Requirements

  • To be considered for this position, candidates must have experience in a similar role, or they must possess significant knowledge, experience, and abilities to successfully perform the responsibilities listed
  • Relevant education and/or training will be considered a plus
  • Experience moving and transforming large volumes of data
  • Ability to learn and support Splunk

Experience with:

  • Python
  • ETL/Data Pipeline Development
  • Kafka
  • Data Validation/Data Quality
  • Troubleshooting production data pipelines

Preferred Skills:

  • Apache NiFi (strong preference)
  • Splunk queries, monitoring, and troubleshooting
  • MongoDB
  • SQL
  • Data flow design and optimization
  • Streaming/data ingestion architectures

Nice-to-Have:

  • Experience with Apache NiFi
  • Telecom or large enterprise data environments
  • Experience with real-time or streaming data architectures
  • Exposure to Hadoop, Spark, or other big data platforms

Benefits & conditions

The pay range is the lowest to highest compensation we reasonably in good faith believe we would pay at posting for this role. We may ultimately pay more or less than this range. Employee pay is based on factors like relevant education, qualifications, certifications, experience, skills, seniority, location, performance, union contract and business needs. This range may be modified in the future.

We offer comprehensive benefits including medical/dental/vision insurance, HSA, FSA, 401(k), and life, disability & ADD insurance to eligible employees. Salaried personnel receive paid time off. Hourly employees are not eligible for paid time off unless required by law. Hourly employees on a Service Contract Act project are eligible for paid sick leave.

Note: Pay is not considered compensation until it is earned, vested and determinable. The amount and availability of any compensation remains in Kforce’s sole discretion unless and until paid and may be modified in its discretion consistent with the law.

About the company

By clicking “Apply Today” you agree to receive calls, AI-generated calls, text messages or emails from Kforce and its affiliates, and service providers. Note that if you choose to communicate with Kforce via text messaging the frequency may vary, and message and data rates may apply. Carriers are not liable for delayed or undelivered messages. You will always have the right to cease communicating via text by using key words such as STOP.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.kforce.com

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

3:28 min

Defining big data and machine learning fundamentals

Ayon Roy · LIVE

2:01 min

Migrating existing applications from MongoDB to Postgres

Nikita Shamgunov Nikita Shamgunov · World Congress 2024

2:38 min

Establishing comprehensive monitoring and log management

Michael Eder +1 · LIVE

3:09 min

Balancing data science skillings alongside systems engineering rigor

Nico Schmidt · LIVE

2:10 min

Why organizations combine big data and machine learning

Ayon Roy · LIVE

1:21 min

Realizing the limitations of MongoDB for live statistics

Josip Stuhli Josip Stuhli · World Congress 2023

Videos

See all

Related articles

See all