Data Engineer
Cognowiz LLC
Herndon, United States of America
7 days ago
Role details
Contract type
Permanent contract Employment type
Full-time (> 32 hours) Working hours
Regular working hours Languages
English Experience level
Junior Compensation
$ 80KJob location
Herndon, United States of America
Tech stack
Java
JavaScript
Amazon Web Services (AWS)
Azure
Big Data
Information Engineering
ETL
Data Warehousing
Relational Databases
Hadoop
Hadoop Distributed File System
HBase
Python
Enterprise Messaging Systems
NoSQL
Redis
SQL Databases
Systems Integration
Spark
Data Lake
Cassandra
Kafka
Data Management
Programming Languages
Job description
Selecting and integrating any Big Data tools and frameworks required to provide requested capabilities.
Implementing ETL process
Requirements
- Knowledge of various persistence (RDBMS, noSQL, HDFS, Cassandra, Redis)
- Good experience in data engineering
- Proficient understanding and experience in one or more programming languages (Java, JavaScript, Python etc.)
- Experience with building data lakes and data warehouses by leveraging any of the major cloud providers (GCP, AWS or Azure) is highly desirable
- Familiar with Hadoop ecosystem (HDFS, HBase etc.), especially Spark
- Good knowledge of Big Data querying tools
- Knowledge of various ETL techniques
- Knowledge of messaging systems, such as Kafka or Rabbit
- Strictly on W2 basis
Job Type: Full-time
Pay: $80,000.00 per year
Experience:
- Informatica: 1 year (Preferred)
- SQL: 1 year (Preferred)
- Data warehouse: 1 year (Preferred)