Technology Architect | Data On Cloud - Platform | AWS

Ipolarity LLC
Charlotte, NC, United States
6 days ago
Apply on www.careerjet.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
5 years minimum
Compensation
$102,675.0 - $175,125.0
Working hours
Regular working hours

Tech stack

Amazon Web Services Apache HTTP Server Cloud Computing Databases Information Engineering Data Governance Data Integration Extract Transform Load (ETL) Data Transformation Data Warehousing Data Processing Freeform SQL
+7 more
Computer Network Technologies Database Performance Pyspark Apache Nifi Virtual Agents Data Pipelines Alteryx

Job description

Analyze and rationalize existing Alteryx workflows and ETL processes.Migrate Alteryx workflows to scalable solutions using PySpark and Apache NiFi.Design, develop, and optimize data pipelines for largescale data processing.Build and maintain batch and near realtime data integration solutions.Develop complex SQL queries and optimize database performance.Ensure data quality, governance, and security standards are maintained.Collaborate with business users, architects, and data engineering teams to Top 3 responsibilities you would expect the Subcon to shoulder and execute Build and maintain batch and near realtime data integration solutions. Develop complex SQL queries and optimize database performance. Ensure data quality, governance, and security standards are maintaine Collaborate with business users, architects, and data engineering teams to understand requirements and implement solutions. Troubleshoot production issues and perform root cause analysis. Create technical documentation, workflow mappings, and migration strategies. Minimum years of experience >10 years Certifications Needed :No Project Code: Network Technology Services

Requirements

Must Have Skills Apache Nifi , Pyspark Analyze and rationalize existing Alteryx workflows and ETL processes. Migrate Alteryx workflows to scalable solutions using PySpark and Apache NiFi. Design, develop, and optimize data pipelines for largescale data processing. Build and maintain batch and near realtime data integration solutions Develop complex SQL queries and optimize database performance. Ensure data quality, governance, and security standards are maintained.5+ years of experience in Data Engineering and ETL Development. Strong Nice to have skills 5+ years of experience in Data Engineering and ETL Development. Strong handson experience with Alteryx Designer and workflow analysis. Experience with data transformation, cleansing, and data quality frameworks. Knowledge of ETL/ELT concepts and Data Warehousing.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.careerjet.com
Prepare application

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

1:34 min

Pivoting careers into specialized platform engineering roles

Xavier Portilla Edo · LIVE

4:32 min

Harnessing Spark with Python using PySpark and Py4J

Ayon Roy · LIVE

3:04 min

Database evolution and the funding behind vector databases

Erik Bamberg · LIVE

3:03 min

Career evolution in data engineering and AI platforms

Maria Apazoglou · Coffee With Developers

3:37 min

Scaling machine learning pipelines from prototypes to petabytes

Julian Joseph · LIVE

4:01 min

Managing application isolation via pluggable database models

Wei Hu Wei Hu · World Congress 2022

Videos

See all

Related articles

See all