Databricks Engineer :: Washington, DC (Remote)

Seeking for a Databricks Engineer responsible for designing, developing, maintaining, and optimizing scalable data pipelines and ETL processes using Databricks, Python, PySpark, and SQL. This role will play a key part in modernizing data platforms and supporting enterprise data initiatives.

Day-to-day Responsibilities:

• Create and maintain ETL pipelines and/or migrate existing legacy pipelines (e.g., synapse) to Databricks
• Develop scalable data processing solutions using Python, PySpark, and SQL.
• Perform data transformation, cleansing, and validation to ensure data quality and consistency.
• Optimize data workflows and Spark jobs for performance and efficiency.
• Collaborate with business stakeholders, data architects, and development teams to understand requirements and deliver effective solutions.
• Monitor, troubleshoot, and resolve data pipeline issues.

Data Management, Database Extract Transform and Load (ETL), Python Programming/Scripting Language, SQL (Structured Query Language), Data Processing, Scalable System Development, Data Quality, Identify Issues, Problem Solving Skills, Computer Programming, * Hands-on experience with Databricks.

• Strong programming skills in Python and PySpark.
• Strong SQL development and query optimization experience.
• Experience designing, developing, and maintaining ETL pipelines.
• Experience working with large-scale data processing and analytics solutions.
• Strong analytical, troubleshooting, and problem-solving skills.
• Excellent communication and collaboration abilities., * Databricks
• Python
• PySpark
• SQL

Education:

• Bachelor’s Degree