Technology Lead | Data On Cloud - Platform | AWS

Ipolarity LLC

Charlotte, NC, United States

11 days ago

Role details

Contract type

Permanent contract

Employment type

Full-time (> 32 hours)

Experience level

Expert

Experience required

8 years minimum

Compensation

$80,000.0 - $165,000.0

Working hours

Regular working hours

Job source

www.careerjet.com

Tech stack

Agile Methodology Airflow Amazon Web Services Amazon S3 Data Analysis Apache HTTP Server Big Data Cloud Computing Information Engineering Data Infrastructure Data Integration Extract Transform Load (ETL)

+23 more

Data Migration Data Systems Data Warehousing Relational Databases Distributed Computing Environment Geocoding Apache Hadoop Apache Hive Python (Programming Language) Oracle (Applications) Performance Tuning Cloud Services SQL Databases Sqoop Teradata SQL Informatica Powercenter Snowflake Database Optimization Apache Spark Data Lakes Pyspark Data Pipelines Amazon Redshift

Job description

Design and develop scalable cloud-native data pipelines. Build and optimize batch and distributed data processing solutions. Manage data lake and warehouse environments. Ensure data quality, performance, security, and reliability. Partner with business and analytics teams to deliver reporting and data solutions. Support data migration, modernization, and platform enhancement initiatives Minimum years of experience 8-10 years Certifications Needed :No Top 3 responsibilities you would expect the Subcon to shoulder and execute Design and develop scalable cloudnative data pipelines. Build and optimize batch and distributed data processing solutions. Manage data lake and warehouse environments. Ensure data quality, performance, security, and reliability. Partner with business and analytics teams to deliver reporting and data solutions. Support data migration, modernization, and platform enhancement initiatives Interview Process (Is face to face required?) Yes Any additional information you would like to share about the project specs/ nature of work Project Code: AVOC Insights Reporting and Analytics 20, Job Description In the assigned Job Role of Data Science Consultant 2, your Area Of Responsibility will be as below: Develop data preparation tasks, while identifying patterns o…

1 month ago

Requirements

ETL, AWS Redshift, SQL, Python 10+ years of Data Engineering / Data Warehouse experience. Strong hands-on experience with AWS (EMR, S3, Glue Catalog, MWAA/Airflow). Expertise in PySpark, Python, and SQL. Experience building and maintaining ETL/ELT pipelines. Strong data warehousing experience with Teradata, Oracle, Redshift, and relational databases. Experience with Apache Iceberg, data lakes, and large-scale data processing. Hands-on experience with Airflow orchestration and workflow automation. Strong performance tuning, data modeling, and database optimization skills. Experience working in Agile environments and collaborating with distributed teams. Nice-to-Have Skills: DBT development experience. Experience with Snowflake. Knowledge of Hadoop ecosystem (Hive, Sqoop, Spark Informatica PowerCenter experience. Geospatial or geocoding data integration experience. Financial services, telecom, or enterprise-scale data platform experience.