Data Architect with Databricks, Python, PySpark & AWS || $65/hr on C2C Max. || Remote || Must have Linkedin and 14+ years of exp. ||
Nestortechnologies Inc
United States
8 days ago
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Apply on www.dice.com
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Contract type
Contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Job source
Tech stack
Amazon Web Services
Amazon S3
Big Data
Cloud Database
Computer Programming
Continuous Integration
Data Architecture
Data Governance
Data Integration
Extract Transform Load (ETL)
Database Design
Apache Hive
+16 more
Identity and Access Management
Python (Programming Language)
Cloud Services
SQL Databases
Data Processing
Cloud Platform System
Data Ingestion
Apache Spark
Database Performance
Git
Data Lakes
Pyspark
Deployment Automation
Data Management
Data Pipelines
Databricks
Job description
We are seeking an experienced Data Architect with strong expertise in Databricks, Python, and AWS to design, develop, and implement scalable, secure, and high-performance data architecture solutions., * Design and implement enterprise-level data architecture using Databricks and AWS.
- Develop scalable data pipelines using Python, PySpark, and Spark SQL.
- Architect cloud-based data lake and lakehouse solutions.
- Integrate data from multiple sources into centralized data platforms.
- Implement ETL/ELT workflows and optimize data processing.
- Establish data governance, security, and quality standards.
- Optimize Databricks workloads and AWS infrastructure for performance and scalability.
- Collaborate with engineering, business, and technical teams.
- Prepare technical architecture documentation and implementation guidelines.
Requirements
The ideal candidate will have extensive experience designing cloud-based data platforms, developing data pipelines, implementing data integration solutions, and optimizing large-scale data processing environments., * Strong experience with Databricks architecture and development.
- Advanced Python programming and development.
- Extensive experience with AWS cloud services.
- Data architecture, data modeling, and database design.
- Designing and developing scalable ETL/ELT pipelines.
- Data ingestion, transformation, and integration.
- Apache Spark / PySpark.
- Databricks Delta Lake and Lakehouse architecture.
- AWS S3, Glue, Lambda, IAM and related services.
- SQL and database performance optimization.
- Data governance, security, and access management.
- CI/CD, Git and deployment automation., * Strong hands-on Databricks, Python, and AWS experience.
- Experience designing enterprise-scale data platforms.
- Excellent communication and technical documentation skills.
- Ability to work independently in a remote environment.
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Apply on www.dice.com
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Good distractions
Loading talks and stories from around this roleβ¦