IT - Project Manager - Engineering | Data Engineering | Platform | Databricks

Ipolarity LLC
North Palm Beach, FL, United States
3 days ago
Apply on www.careerbuilder.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
10 years minimum
Working hours
Regular working hours

Tech stack

Application Programming Interfaces (APIs) Airflow Amazon Web Services Amazon S3 Data Analysis Apache HTTP Server Continuous Integration Information Engineering Data Systems Data Warehousing Identity and Access Management Systems Development Life Cycle
+18 more
Query Optimization Power BI SQL Databases Web Services Data Logging Data Processing Freeform SQL Cloud Platform System Microsoft Power Automate AWS Lambda Git Deployment Automation AWS Glue Data Analytics Data Management Data Pipelines Amazon Redshift Databricks

Job description

UPDATED CONTACT NUMBER and EMAIL ID is a MANDATORY REQUEST from our client for all the submissions Limited to 2 submission per supplier. Please submit your best. We prioritize endorsing those with complete and accurate information Avoid submitting duplicate profiles. We will Reject/Disqualify immediately. Make sure that candidate’s interview schedules are updated. Please inform the candidate to keep their lines open.

MANDATORY: Please include in the resume the candidate s complete & updated contact information (Phone number, Email address and Skype ID) as well as a set of 5 interview timeslots over a 72-hour period after submitting the profile when the hiring managers could potentially reach to them. PROFILES WITHOUT THE REQUIRED DETAILS and TIME SLOTS will be REJECTED., Design and develop scalable ETLELT data pipelines on AWS. Build and maintain data lakes and data warehouse solutions. Develop data processing solutions using AWS Glue, Amazon S3, AWS Lambda, Amazon Athena, and Amazon Redshift. Develop and optimize complex SQL queries for analytics and reporting. Use PythonPySpark for data processing, transformation, and automation. Work with large structured and semistructured datasets. Implement data quality checks, monitoring, logging, and error handling mechanisms. Optimize data pipelines for performance, scalability, reliability, and cost. Implement appropriate AWS IAM roles and access controls for data solutions. Collaborate with Data Analysts, Data Scientists, BI teams, and application teams to understand data requirements. Support production issues and perform rootcause analysis. Strong handson experience with AWS Data Analytics services AWS GlueAmazon S3Amazon RedshiftAmazon AthenaAWS LambdaSQLPython PySparkAmazon EMR Apache SparkAmazon Kinesis or KafkaAmazon QuickSightAirflow AWS Managed Workflows for Apache Airflow MWAAExperience with APIs and JSONParquet data formats Analytics . Design dimensional data models. You will automate deployments using Git and CICD, and deliver interactive Power BI dashboards with DAX to drive business decisions.

Please provide the TOP skills, and the years of experience that you ll consider: Data bricks, Power BI, Power automate

Requirements

Engineering Management, Project/Program Management, Scalable System Development, Data Management, Amazon Web Services (AWS), Data Warehousing, SQL (Structured Query Language), Query Analysis, Query Optimization, Data Processing

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.careerbuilder.com
Prepare application

Good distractions

Loading talks and stories from around this role…