RSA Databricks Consultant
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Tech stack
+24 more
Job description
- Consult directly with customers to design, optimize, and fine-tune Databricks environments.
- Design, build, and maintain scalable ETL/ELT pipelines in Databricks.
- Optimize Databricks workflows, clusters, and architecture for performance, scalability, and cost efficiency.
- Integrate Databricks solutions with AWS, Azure, and Google Cloud Platform cloud environments.
- Implement data governance, security, and compliance best practices.
- Utilize technologies including Apache Spark, Delta Lake, MLflow, and Databricks Machine Learning.
- Collaborate with data scientists, analysts, engineers, and business stakeholders to deliver trusted datasets and actionable insights.
- Troubleshoot platform and infrastructure issues while driving continuous improvement initiatives.
Requirements
- Proven experience working with Databricks in production environments.
- Strong proficiency in Python and/or SQL for data engineering.
- Experience with Apache Spark for distributed data processing.
- Knowledge of data lakehouse architecture and best practices.
- Experience with cloud data platforms such as AWS S3, Azure Data Lake, or Google Cloud Platform Storage.
- Hands-on experience building and managing ETL/ELT pipelines.
- Strong understanding of data modeling, data quality, and performance tuning.
- Familiarity with CI/CD pipelines and version control (Git).
- Bachelor’s degree; preferably in Computer Science, Information Security, or a related field. Experience will be considered in lieu of a degree.
- Ability to travel, as needed, to customer sites.
Preferred Qualifications
- Master’s degree or PhD in Computer Science, Data Science, or a related field.
- Experience with machine learning pipelines in Databricks (MLflow).
- Knowledge of Delta Lake and Unity Catalog for governance.
- Familiarity with streaming technologies (Kafka, Kinesis, or Event Hubs).
- Exposure to data visualization tools (Tableau, Power BI, or Looker).
- Experience with Terraform, ARM, or CloudFormation for infrastructure as code.
- Background in data security and compliance (HIPAA, FedRAMP, SOC2, etc.).
- Strong understanding of DevOps/MLOps practices.
- Prior consulting or customer-facing experience.
Benefits & conditions
We are seeking a skilled individual with deep experience in Databricks to join our team. The primary responsibility of this role is to consult with customers to design, optimize, and fine-tune their Databricks environments for advanced data analytics, machine learning, and AI-driven insights. This role will support professional services and managed cybersecurity services programs, with a focus on Databricks solutions. This position is contingent upon additional funding.
About the company
Everforth Apex is a world-class IT services company that serves thousands of clients across the globe. When you join Everforth Apex, you become part of a team that values innovation, collaboration, and continuous learning. We offer quality career resources, training, certifications, development opportunities, and a comprehensive benefits package. Our commitment to excellence is reflected in many awards, including ClearlyRateds Best of Staffing in Talent Satisfaction in the United States and Great Place to Work in the United Kingdom and Mexico.
Everforth Apex uses a virtual recruiter as part of the application process. Click for more details. By applying for this job, you agree to receive calls, AI-generated calls, text messages, or emails from Everforth Apex and its affiliates, and contracted partners. Frequency varies for text messages. Message and data rates may apply. Carriers are not liable for delayed or undelivered messages. You can reply STOP to cancel and HELP for help. You can access our privacy policy at
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Apply on www.dice.comGood distractions
Talks and stories from around this role — technically off-topic, practically not.
Moments
Explore playlistsVideos
See allRelated articles
See all
Highest Paying Tech Companies for Developers
Top Big Data Technologies That You Need to Know
Making Data Warehouses Fast: A Developer’s Story
Coffee with Developers - Maria Apazoglou - Making AI understandable for all in production