Data Engineer (Fulltime)
Lorven Technologies Inc
Richardson, United States of America
yesterday
Role details
Contract type
Permanent contract Employment type
Full-time (> 32 hours) Working hours
Regular working hours Languages
EnglishJob location
Richardson, United States of America
Tech stack
API
Azure
Databases
Continuous Integration
Information Engineering
ETL
Data Transformation
Data Warehousing
Relational Databases
Hive
Machine Learning
NoSQL
Power BI
Azure
SQL Databases
Data Ingestion
Azure
Delivery Pipeline
Spark
Data Lake
PySpark
Data Pipelines
Databricks
Job description
Our client is looking Data Engineer for Long term project in Plano, TX (Onsite) Below is the detail requirement., * s:Design, develop, and maintain end-to-end data pipelines using data ingestion tools and Azure Databric
- ksImplement scalable data ingestion frameworks (batch and incremental) from diverse data sources (APIs, databases, files, cloud storag
- e)Build and optimize data transformation logic using Spark (Databricks), SQL, and Pyth
- onDevelop and maintain data models supporting analytics, reporting, and machine learning use cas
- esCollaborate with analytics teams to enable Power BI datasets and reporting solutio
- nsEnsure data quality, reliability, and consistency through validation frameworks and monitori
- ngOptimize performance of pipelines, storage, and compute resources in Azu
- reImplement data governance practices, including lineage, cataloging, and documentati
- onSupport CI/CD deployment pipelines for data engineering workflo
Requirements
- ons5+ years of experience in Data Engineering ro
- lesStrong hands-on experience with data ingestion / ETL / ELT tools like Azure Data Factory and data modell
- ingProficient in using Azure Databricks (PySpark/Spark SQL) and medallion architect
- ureExperience with other SQL databases, relational databases and NoSQL databa
- sesUnderstanding of data lake and data warehouse architectures (e.g., Azure Data Lake, One Lake, Delta Tables) Experience working with large-scale structured and semi-structured datas
- etsAbility to work with cross-functional teams and translate business requirements into technical soluti