Azure Databricks Engineer
Role details
Job location
Tech stack
Job description
The Azure Databricks Engineer will design, build, and optimize scalable data pipelines and lakehouse solutions using Azure Databricks. This role is critical for enabling advanced analytics and supporting machine learning initiatives. This role requires US Citizenship., Develop and maintain ETL/ELT pipelines using Databricks workflows, Delta Lake, and Apache Spark.
. Architect and optimize data lakehouse solutions for efficient storage and retrieval.
. Configure and manage Databricks workspaces, clusters, and implement security and cost optimization strategies.
. Build real-time streaming and batch processing solutions for diverse data sources.
. Collaborate with data scientists to deploy ML models and automate ML pipelines using MLflow.
. Monitor pipeline performance, troubleshoot issues, and optimize Spark jobs for efficiency.
Requirements
BA/BS/MS in Computer Science, Engineering, or Data Science.
. 5+ years as a Data Engineer, with 3+ years in Azure Databricks.
. Expertise in Apache Spark, Delta Lake, Python, SQL, Scala.
. Proficiency in Azure Data Factory, Data Lake Storage, Synapse Analytics.
. Strong understanding of ETL/ELT, data modeling, and big data technologies.
Desired qualifications/non-essential skills required:
. Certifications: Microsoft Certified: Azure Data Engineer Associate (DP-203) or Databricks Certified Data Engineer.
. Experience with Agile methodology, data governance, and security., * Data Engineering
- Enterprise Architecture
Benefits & conditions
CGI is required by law in some jurisdictions to include a reasonable estimate of the compensation range for this role. The determination of this range includes various factors not limited to skill set, level, experience, relevant training, and licensure and certifications. To support the ability to reward for merit-based performance, CGI typically does not hire individuals at or near the top of the range for their role. Compensation decisions are dependent on the facts and circumstances of each case. A reasonable estimate of the current range for this role in the U.S. is $80,600.00 - $141,100.
CGI Federal's benefits are offered to eligible professionals on their first day of employment to include:
. Competitive compensation
. Comprehensive insurance options
. Matching contributions through the 401(k) plan and the share purchase plan
. Paid time off for vacation, holidays, and sick time
. Paid parental leave
. Learning opportunities and tuition assistance
. Wellness and Well-being programs