Data Engineer IV

Our client is seeking a Data Engineer to support large-scale data initiatives and platform optimization efforts. This role will focus on building and maintaining data pipelines, optimizing jobs and resource utilization, and ensuring efficient data processing across the organization’s environment. The ideal candidate will have strong experience in Java, Databricks, Bash scripting, and version control systems. Experience optimizing jobs, improving performance, and managing resource consumption is highly desired.

Strong Java development experience Databricks experience Bash/Shell scripting Version control experience (Git or similar) Experience optimizing jobs, workflows, and resource utilization Data pipeline development and maintenance Strong troubleshooting and performance tuning skills Experience working in enterprise-scale data environments AWS experience Spark/PySpark experience CI/CD pipeline knowledge Infrastructure automation experience Data warehouse and data lake experience Performance monitoring and observability tools Experience supporting machine learning or analytics workloads Exposure to distributed computing environments