Data Architect with Databricks, Python, PySpark & AWS || $65/hr on C2C Max. || Remote || Must have Linkedin and 14+ years of exp. ||

Nestortechnologies Inc
United States
8 days ago
Apply on www.dice.com
Prepare application

Role details

Contract type
Contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Job source

Tech stack

Amazon Web Services Amazon S3 Big Data Cloud Database Computer Programming Continuous Integration Data Architecture Data Governance Data Integration Extract Transform Load (ETL) Database Design Apache Hive
+16 more
Identity and Access Management Python (Programming Language) Cloud Services SQL Databases Data Processing Cloud Platform System Data Ingestion Apache Spark Database Performance Git Data Lakes Pyspark Deployment Automation Data Management Data Pipelines Databricks

Job description

We are seeking an experienced Data Architect with strong expertise in Databricks, Python, and AWS to design, develop, and implement scalable, secure, and high-performance data architecture solutions., * Design and implement enterprise-level data architecture using Databricks and AWS.

  • Develop scalable data pipelines using Python, PySpark, and Spark SQL.
  • Architect cloud-based data lake and lakehouse solutions.
  • Integrate data from multiple sources into centralized data platforms.
  • Implement ETL/ELT workflows and optimize data processing.
  • Establish data governance, security, and quality standards.
  • Optimize Databricks workloads and AWS infrastructure for performance and scalability.
  • Collaborate with engineering, business, and technical teams.
  • Prepare technical architecture documentation and implementation guidelines.

Requirements

The ideal candidate will have extensive experience designing cloud-based data platforms, developing data pipelines, implementing data integration solutions, and optimizing large-scale data processing environments., * Strong experience with Databricks architecture and development.

  • Advanced Python programming and development.
  • Extensive experience with AWS cloud services.
  • Data architecture, data modeling, and database design.
  • Designing and developing scalable ETL/ELT pipelines.
  • Data ingestion, transformation, and integration.
  • Apache Spark / PySpark.
  • Databricks Delta Lake and Lakehouse architecture.
  • AWS S3, Glue, Lambda, IAM and related services.
  • SQL and database performance optimization.
  • Data governance, security, and access management.
  • CI/CD, Git and deployment automation., * Strong hands-on Databricks, Python, and AWS experience.
  • Experience designing enterprise-scale data platforms.
  • Excellent communication and technical documentation skills.
  • Ability to work independently in a remote environment.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.dice.com
Prepare application

Good distractions

Loading talks and stories from around this role…