Data Engineer
Intersources Inc.
United States
2 days ago
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Apply on www2.jobdiva.com
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
5 years minimum
Working hours
Regular working hours
Job source
Tech stack
Microsoft Azure
Databases
Directed Acyclic Graph (Directed Graphs)
Extract Transform Load (ETL)
Relational Databases
Database Design
DevOps
Monitoring of Systems
Python (Programming Language)
Performance Tuning
Systems Development Life Cycle
Power BI
+11 more
Cloud Services
PL-SQL
SQL Databases
Data Ingestion
Azure Data Factory
Apache Spark
Data Lakes
Pyspark
Azure Synapse Analytics
Software Version Control
Databricks
Job description
- Monitor and troubleshoot Databricks jobs.
- Possess a strong understanding of database fundamentals, including relational database design and PL/SQL.
- Have substantial hands on experience and knowledge in PowerBI.
- Work closely with clients and support teams to review and manage deliverables.
- Design and optimize ETL workflows using Databricks, Azure Data Factory.
- Manage data ingestion.
- Maintain code versioning using Devops and follow SDLC best practices.
- Perform root cause analysis and performance tuning using Spark UI, DAGs, and logs.
Requirements
- Hands-on experience with Spark, Delta Lake, and PySpark.
- Proficiency in SQL, Python, and cloud services (Azure).
- Experience with Azure Synapse, and Blob Storage.
- Familiarity with CI/CD pipelines and monitoring tools.
- Strong communication and customer-facing skills.
- Proficiency in PowerBI and SQL or PL/SQL.
- Strong understanding of database design and data modeling.
- Excellent problem-solving skills and attention to detail.
- Strong communication and team collaboration skills.
- 5+ years of experience with Azure(ADF, synapse) and Databricks in production environments.
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Apply on www2.jobdiva.com
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Good distractions
Loading talks and stories from around this roleβ¦