Data Engineer
Ampcus Inc
Reston, VA, United States
1 day ago
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Apply on jobs.localjobnetwork.com
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
10 years minimum
Working hours
Regular working hours
Job source
Tech stack
Clean Code Principles
Java (Programming Language)
Agile Methodology
Amazon Web Services
Amazon S3
Automation of Tests
Unit Testing
Big Data
Software Bug Management
Cloudera Impala
Databases
Data Integration
+22 more
Extract Transform Load (ETL)
Data Warehousing
Apache Hadoop
Hadoop Distributed File System
Apache Hive
Online Analytical Processing
NoSQL
Online Transaction Processing
Queueing Systems
Cloudera
Runbook
Shell Script
SQL Databases
Ab Initio
Change Data Capture
Data Layers
Build Management
Information Technology
Data Analytics
Data Management
Hardware Infrastructure
Data Pipelines
Job description
- The Senior Data Engineer is responsible for orchestrating, deploying, maintaining and scaling cloud OR on-premise infrastructure targeting big data and platform data management (Relational and NoSQL, distributed and converged) with emphasis on reliability, automation and performance.
- This role will focus on developing solutions and helping transform the company’s platforms deliver data-driven, meaningful insights and value to company.
Essential Functions:
- Work with Business Analysts and Product team to gather data requirements.
- Design and Build Abinitio data graphs and data pipelines to extract the data various databases/flat files/message queues.
- Transform the data to create a consumable data layer for various application uses.
- Support Data pipeline with bug fixes, and additional enhancements.
- Document Technical design, Operational Runbook etc.
Requirements
- To perform this job successfully, an individual must be able to perform each essential duty satisfactorily. The requirements listed below are representative of the knowledge, skill, and/or ability required.
- Reasonable accommodations may be made to enable individuals with disabilities to perform the essential functions.
Education Level:
- Bachelor’s Degree.
Education Details:
- Computer Science, Information Technology or Engineering or related field., * Total of 10 Years of IT Experience predominantly in Data Integration/Data Warehouse area.
- Must have at least 5 years of ETL Design and Development experience using Ab Initio.
- 1-2 years of Data Integration project experience on Hadoop Platform, preferably Cloudera.
- Abinitio CDC (Change Data Capture) experience in a Data Integration/ETL project setting is great to have.
- Working knowledge of HDFS, Hive, Impala and other related Hadoop technologies.
- Abinitio integration with AWS S3 and Redshift and/or other AWS database services.
- Sound understanding of SQL and ability to write well-performing SQL queries.
- Good knowledge of OLTP and OLAP data models and other data warehouse fundamentals.
- Rigor in high code quality, automated testing, and other engineering best practices, ability to write reusable code components.
- Ability to unit test the code thoroughly and to troubleshoot issues in production environments.
- Must have some working experience with Unix/Linux shell scripting.
- Must be able to work independently and support other junior developers as needed.
- Some Java development experience is nice to have.
- Knowledge of Agile Development practices is required.
About the company
Ampcus Inc. is a certified global provider of a broad range of Technology and Business consulting services. We are in search of a highly motivated candidate to join our talented Team.
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Apply on jobs.localjobnetwork.com
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Good distractions
Talks and stories from around this role — technically off-topic, practically not.
Moments
Explore playlistsVideos
See allRelated articles
See all
BB
Benedikt Bischof
about 4 years ago
DS
Dhannush Subramani
Top Big Data Technologies That You Need to Know
about 4 years ago
EM
Eli McGarvie
Highest Paying Tech Companies for Developers
over 3 years ago
IK
Igor Khokhriakov
How We Built a Worry-Free System That Runs for 10+ Years – And What We’d Do Again
24 days ago
EM
Eli McGarvie
Data Engineer Salary UK
about 3 years ago
LM
Luis Minvielle
The Most Popular IT Jobs on the Market
over 2 years ago