Databricks Data Engineer - Remote / Telecommute
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Tech stack
+19 more
Job description
The candidate will design, develop, and maintain scalable data engineering solutions using Databricks, PySpark, Spark SQL, and Apache Spark. The successful candidate will build and optimize end-to-end ETL/ELT pipelines integrating Databricks with AWS S3, Snowflake, Airflow, and AWS Glue.
The candidate s responsibilities include processing and transforming large-scale structured and semi-structured datasets to support enterprise reporting, analytics, and regulatory requirements. The candidate will develop reusable frameworks and components for data ingestion, cleansing, transformation, validation, reconciliation, enrichment, and business rule implementation.
The successful candidate will implement robust data quality checks, monitoring, and governance controls to ensure data accuracy and reliability. The candidate will perform performance tuning and optimization of Spark applications and Databricks workloads to improve scalability and processing efficiency.
The candidate will collaborate with business stakeholders, architects, and analytics teams to understand data requirements and deliver scalable solutions. The successful candidate will troubleshoot and resolve production data pipeline issues while ensuring high availability and reliability, supporting advanced analytics, customer segmentation, campaign analytics, AML/regulatory reporting, and data validation initiatives.
Requirements
The organization is seeking an experienced Senior Databricks Data Engineer with strong expertise in designing, developing, and optimizing large-scale data engineering solutions on the Databricks platform. The ideal candidate will have extensive hands-on experience in building enterprise-grade data pipelines, processing high-volume datasets, and delivering scalable analytics solutions using PySpark, Spark SQL, and AWS cloud technologies., * 7+ years of hands-on experience with Databricks and modern data engineering platforms.
- Strong expertise in PySpark, Spark SQL, Apache Spark, and Databricks Lakehouse Architecture.
- Experience building and managing ETL/ELT pipelines on cloud platforms.
- Strong experience with AWS S3, Snowflake, Apache Airflow, and AWS Glue.
- Knowledge of data modeling, data warehousing, and big data processing techniques.
- Experience working with structured and semi-structured data formats such as JSON, Parquet, Avro, and CSV.
- Hands-on experience implementing data quality frameworks and monitoring solutions.
- Strong SQL and data analysis skills.
Preferred Skills:
- Experience with regulatory reporting, AML, compliance, or financial data domains.
- Exposure to CI/CD and DevOps practices for data engineering.
- Experience with Delta Lake, Databricks Workflows, and Unity Catalog.
- Knowledge of Agile/Scrum delivery methodologies.
Key Experience Areas:
The candidate should have demonstrated experience in one or more of the following:
- Customer Segmentation Analytics.
- Campaign Analytics.
- AML and Regulatory Reporting.
- Enterprise Data Platforms.
- Production Data Pipeline Support.
- Data Validation and Reconciliation.
- Large-Scale Data Migration and Modernization Programs.
Benefits & conditions
Our Benefits Include:
- Medical, Dental, and Vision Insurance
- 401(k) Retirement Plan
- Health Savings Account (HSA)
- Disability Insurance (Short-Term and Long-Term)
- Life and AD&D Insurance
- Paid Sick Leave (where required by applicable state or local law)
- Supplemental Insurance Plans
- Identity Theft Protection
- Pet Insurance
- Employee Wellness Programs
- Employee Assistance Program (EAP)
- Career Growth and Professional Development Opportunities
About the company
Founded in 2010 and headquartered in the Washington, DC metro area, Cynet Systems Inc. is a leading technology staffing and workforce solutions company serving Fortune 500 companies, government agencies, and enterprise organizations across the United States and Canada. We deliver agile, scalable talent solutions across IT, engineering, life sciences, clinical, and professional staffing, powered by a high-performing recruitment engine operating across North America and Asia.
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Good distractions
Talks and stories from around this role — technically off-topic, practically not.
Moments
Explore playlistsVideos
See allRelated articles
See all
Fully Remote Software Engineer Jobs
Highest Paying Tech Companies for Developers
Making Data Warehouses Fast: A Developer’s Story
Top Big Data Technologies That You Need to Know