DATA ENGINEER

THE JUDGE GROUP, INC.

Conshohocken, PA, United States

2 months ago

Role details

Contract type

Permanent contract

Employment type

Full-time (> 32 hours)

Experience level

Expert

Experience required

5 years minimum

Working hours

Regular working hours

Job source

dice.com

Tech stack

Java (Programming Language) Microsoft Azure Cloud Computing Computer Programming Information Engineering Data Governance Data Infrastructure Extract Transform Load (ETL) Data Mining Data Systems Data Visualization Python (Programming Language)

+9 more

Power BI Freeform SQL Data Strategy Git Microsoft Fabric Information Technology Software Version Control Data Pipelines Programming Languages

Job description

The Data Engineer plays a crucial role in designing, developing, and maintaining scalable data pipelines and architectures using Microsoft Fabric, significantly contributing to the organization’s data strategy and broader goals. This role involves implementing ETL processes to ensure data accuracy and availability, optimizing data workflows for performance, and providing guidance on visualization tools like Power BI. The Data Engineer is responsible for monitoring and troubleshooting data pipeline issues, developing comprehensive documentation, and staying updated with the latest trends in data engineering., oDesign, develop, and maintain scalable data pipelines and architectures using Microsoft Fabric.

oImplement ETL processes to ensure data accuracy and availability.

oOptimize and tune data workflows for performance and scalability.

Visualization and Guidance

oProvide guidance on visualization tools, focusing on Power BI.

oContribute to guidelines and standards for visualization techniques and analytic dashboards.

Monitoring and Troubleshooting

oMonitor and troubleshoot data pipeline issues, ensuring timely resolution.

Documentation and Best Practices

oDevelop and maintain documentation for data processes, architectures, and workflows.

oStay updated with the latest trends and best practices in data engineering and Microsoft Fabric.

Additional Duties: Tasks or duties not outlined in this job description may be required to contribute to the organization’s success and efficiency.

Requirements

Collaboration with cross-functional teams is essential, as this role supports the creation of innovative and efficient data solutions that drive strategic decision-making and operational success. The ideal candidate is proficient in programming languages such as Python, Java, or Scala, and has a strong understanding of data governance and security best practices. This position is pivotal in ensuring the integrity and performance of the organization’s data infrastructure, aligning with the company’s commitment to excellence and innovation., Bachelor’s in computer science, data engineering, statistics, mathematics, or related fields.

5 years in data visualization, data mining, and analysis using Power BI

Proven experience as a Data Engineer, with a focus on MS Tech stack; Microsoft Fabric preferred.

Ability to write complex SQL queries.

Experience with Azure DevOps Git for version control.

Experience creating data pipelines within Fabric workspace to transfer transformed data from Lakehouse to warehouse tables within Fabric workspace.

Understanding of data governance and security best practices.

Tools & Systems:

Proficiency in programming languages such as Python, Java, or Scala.

Familiarity with cloud platforms such as Azure.

Experience with CI/CD pipelines and automation tools.

The role involves frequent use of standard office equipment, such as computers, phones,

and printers.