Jr. Data Engineer
Kalani Consulting
Leesburg, United States of America
10 days ago
Role details
Contract type
Permanent contract Employment type
Full-time (> 32 hours) Working hours
Regular working hours Languages
English Experience level
JuniorJob location
Remote
Leesburg, United States of America
Tech stack
Automation of Tests
Information Systems
Data Infrastructure
ETL
Data Warehousing
Relational Databases
Dimensional Modeling
Hive
Metadata
NoSQL
Reference Data
SQL Databases
Spark
Star Schema
Data Management
Data Pipelines
Serverless Computing
Databricks
Job description
- Engineer, build and maintain scalable automated data pipelines.
- Build cloud data solutions and provide domain perspective on storage, big data platform services, serverless architecture, RDBMS, DW/DM, NoSQL databases and security.
- Deploy, automate, maintain, and manage cloud-based production system, to ensure the availability, performance, scalability, and security of productions systems.
- Implement best practices in management of data, including master data, reference data, metadata, data quality and lineage.
- Support regular and ad-hoc data querying and analysis to understand customer behaviors.
Requirements
Do you have experience in System deployment?, Do you have a Bachelor's degree?, * BA or BS degree in CS, Information Systems, or related field.
- Experience developing and deploying ETL pipelines using Apache Spark and/or Databricks.
- Experience in SQL and/or Spark SQL.
- Familiarity with Informatica a plus.
- Knowledge of dimensional models in data warehouses.
- Experience working on loading data to the Star Schema.
Preferred Qualification
- Knowledge of and experience with automated testing.
- Knowledge and experience of deployment of Spark Notebooks.
Clearance Requirement
Must be US Citizen with the ability to obtain and maintain a US Public Trust Suitability.