Onsite - Data Engineer (Azure, Databricks), Clearfield, UT
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Tech stack
+8 more
Job description
Dhaka Technologies Limited Company (DTLC) is hiring a Data Engineer for a public sector research client in Clearfield, Utah. The clientβs lab and manufacturing equipment (furnaces and ovens, microscopes, 3D printers, inspection and testing machines) currently stores its data locally on each machine. You will build a central research database: extract data from each machine into Azure Blob Storage in an Azure Government account, stage and transform it in Databricks, and design a data model that researchers can use for analytics and data science., * Work with the clientβs staff to extract data from each machine (log files, memory registers, images and test outputs) and upload it to Azure Blob Storage, refining existing extraction processes where needed.
- Build a staging environment in Databricks with staging tables that check and enforce data types.
- Design and build the production data model and tables, including references to image files stored in blob storage, with the right level of structure for research analytics.
- Set up orchestration for ingestion and transformation, with alerts when ingestion fails or data is missing or corrupted.
- Help the clientβs staff build automated reporting and analytics on the production data.
- Help maintain and refine the clientβs data dictionary and prioritize data sources.
- Document the work and deliver training (slides, notes, recorded sessions) so the clientβs team can maintain and extend the platform, and mentor student interns.
- Attend weekly meetings with the client and remain available for questions after the engagement.
Requirements
Microsoft Windows Azure, United States Citizen, Testing, Data Science, Data Modeling, Manufacturing Equipment, Printers, Government, Microsoft Windows Azure, Laboratory Equipment, * At least 3 years of data engineering experience.
- Experience with data ingestion, data pipelines, data modeling and pipeline monitoring.
- Experience with cloud computing (Azure, AWS or GCP), including infrastructure as a service and platform as a service.
- Experience with data security, permission management and secure networking.
- U.S. citizen able to work onsite in Clearfield, UT full time for six months.
- References who can speak to your data engineering work.
- Must pass a criminal background check., * Apache Spark and Databricks experience.
- Experience managing data in a data lake or lakehouse.
- Microsoft Azure experience, including Azure Government.
- Experience with data from manufacturing, laboratory or industrial equipment.
- Experience training or supervising interns or students.
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Good distractions
Loading talks and stories from around this roleβ¦