Master Data Management Staff Engineer

NOVACOMP, INC
United States
about 1 month ago
Apply on www.indeed.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Experienced
Experience required
3 years minimum
Compensation
$60,000.0 - $120,000.0
Working hours
Shift work
Job source

Tech stack

Agile Methodology Artificial Intelligence Amazon Web Services Amazon S3 Data Analysis Automation of Tests Cloud Database Databases Data Architecture Information Engineering Extract Transform Load (ETL) Data Warehousing
+38 more
IBM DB2 Relational Databases Software Debugging DevOps Web Development Amazon DynamoDB R (Programming Language) Python (Programming Language) Machine Learning Microsoft SQL Server MongoDB Node.Js NoSQL Oracle (Applications) Programming Environments Power BI SAS (Software) Service-Oriented Architecture Software Deployment Software Engineering Software Requirements Analysis Systems Architecture Tableau (Software) Web Services Qliksense Snowflake Marklogic Apache Spark Data Lakes AWS Glue Data Analytics Apache Kafka Data Management Tools for Reporting Functional Programming Terraform Data Pipelines Microservices

Job description

The Staff Engineer will build and operationalize enterprise data and analytics initiatives using industry-standard tools and practices. This person will design, manage, and optimize data pipelines and automate production deployments - a technical leadership role partnering closely with business and IT stakeholders to solve business problems through data engineering and analytics., * Design and develop pipelines ingesting from relational databases (Oracle, SQL Server, DB2, Aurora), file shares, and web services

  • Build streaming ingestion using Kinesis Streams, Kinesis Firehose, Kinesis Analytics, and Kafka (MSK)
  • Build and optimize a Data Lake on AWS S3 (partitioning, compression)
  • Perform data engineering/analytics using AWS Glue, Informatica, EMR, Spark, Athena, Python, PowerBI, and SageMaker
  • Data modeling and Data Warehouse development using Snowflake
  • Participate in requirements definition, system architecture, and data architecture design
  • Contribute across the full software lifecycle using Agile methodologies

Requirements

  • 8+ years in Enterprise Information Solution Architecture, design, and development
  • 8+ years hands-on with AWS (S3, Kinesis, Lambda, Athena, Glue, EMR)
  • 8+ years with integration architectures (ETL, SOA, Microservices, or similar)
  • 5+ years web development with Python and Node.js
  • 3+ years building cloud data warehouses (Snowflake and/or Redshift)
  • 3+ years with NoSQL databases (DynamoDB, MarkLogic, MongoDB)
  • 3+ years with BI tools (Qlik Sense, Tableau, or PowerBI)
  • 3+ years with analytics tools (SAS, R, Python, or similar)
  • Experience with Machine Learning / AI
  • Experience with DevOps and Terraform
  • Strong knowledge of multiple programming environments, debugging, and testing tools
  • Solid domain knowledge of NoSQL and/or relational databases
  • Proven experience developing enterprise-grade production software
  • Understanding of database architecture and performance implications
  • Excellent written/verbal communication; strong ownership, urgency, and drive
  • Ability to multitask and thrive in a collaborative Agile team

Benefits & conditions

Pay: $5,000.00 - $10,000.00 per month

Application Question(s):

  • What is your salary expectation in USD per month as a contractor?
  • Planned vacations (dates and month)
  • Period of notice

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.indeed.com
Prepare application

Good distractions

Loading talks and stories from around this role…