DATA ENGINEER

THE JUDGE GROUP, INC.
Conshohocken, United States of America
2 days ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English
Experience level
Senior

Job location

Conshohocken, United States of America

Tech stack

Java
Azure
Cloud Computing
Computer Programming
Information Engineering
Data Governance
Data Infrastructure
ETL
Data Mining
Data Systems
Data Visualization
Python
Power BI
Freeform SQL
Data Strategy
GIT
Microsoft Fabric
Information Technology
Software Version Control
Data Pipelines
Programming Languages

Job description

The Data Engineer plays a crucial role in designing, developing, and maintaining scalable data pipelines and architectures using Microsoft Fabric, significantly contributing to the organization's data strategy and broader goals. This role involves implementing ETL processes to ensure data accuracy and availability, optimizing data workflows for performance, and providing guidance on visualization tools like Power BI. The Data Engineer is responsible for monitoring and troubleshooting data pipeline issues, developing comprehensive documentation, and staying updated with the latest trends in data engineering., oDesign, develop, and maintain scalable data pipelines and architectures using Microsoft Fabric.

oImplement ETL processes to ensure data accuracy and availability.

oOptimize and tune data workflows for performance and scalability.

Visualization and Guidance

oProvide guidance on visualization tools, focusing on Power BI.

oContribute to guidelines and standards for visualization techniques and analytic dashboards.

Monitoring and Troubleshooting

oMonitor and troubleshoot data pipeline issues, ensuring timely resolution.

Documentation and Best Practices

oDevelop and maintain documentation for data processes, architectures, and workflows.

oStay updated with the latest trends and best practices in data engineering and Microsoft Fabric.

Additional Duties: Tasks or duties not outlined in this job description may be required to contribute to the organization's success and efficiency.

Requirements

Collaboration with cross-functional teams is essential, as this role supports the creation of innovative and efficient data solutions that drive strategic decision-making and operational success. The ideal candidate is proficient in programming languages such as Python, Java, or Scala, and has a strong understanding of data governance and security best practices. This position is pivotal in ensuring the integrity and performance of the organization's data infrastructure, aligning with the company's commitment to excellence and innovation., Bachelor's in computer science, data engineering, statistics, mathematics, or related fields.

5 years in data visualization, data mining, and analysis using Power BI

Proven experience as a Data Engineer, with a focus on MS Tech stack; Microsoft Fabric preferred.

Ability to write complex SQL queries.

Experience with Azure DevOps Git for version control.

Experience creating data pipelines within Fabric workspace to transfer transformed data from Lakehouse to warehouse tables within Fabric workspace.

Understanding of data governance and security best practices.

Tools & Systems:

Proficiency in programming languages such as Python, Java, or Scala.

Familiarity with cloud platforms such as Azure.

Experience with CI/CD pipelines and automation tools.

The role involves frequent use of standard office equipment, such as computers, phones,

and printers.

Apply for this position