Data Engineer- AWS
Role details
Job location
Tech stack
Job description
As a Data Engineer III specializing in Python, Spark, and Data Lake technologies within the Consumer and Community Bank, you will be a key member of an agile team. Your role will involve designing and delivering reliable data collection, storage, access, and analytics solutions that are secure, stable, and scalable. You will develop, test, and maintain essential data pipelines and architectures across diverse technical areas, supporting various business functions to achieve organizational objectives., * Review and ensure sufficient protection of enterprise data through controls.
- Make custom configuration changes in tools to meet business or customer requests.
- Update logical or physical data models based on new use cases.
- Utilize SQL frequently and understand NoSQL databases and their applications.
- Contribute to a team culture of diversity, opportunity, inclusion, and respect.
- Develop enterprise data models and maintain large-scale data processing pipelines.
- Lead code reviews and provide mentoring to team members.
- Drive data quality and ensure data accessibility for analysts and data scientists.
- Ensure compliance with data governance requirements and alignment with business goals.
Requirements
- Formal training or certification in data engineering concepts with 2+ years of applied experience.
- Experience across the data lifecycle with advanced SQL skills and understanding of NoSQL databases.
- Proficiency in statistical data analysis and determining appropriate tools and data patterns.
- Extensive experience in AWS and maintaining data pipelines using Python and PySpark.
- Proficient in Python and PySpark for writing and executing complex queries.
- Proven experience in performance tuning to optimize job execution.
- Advanced proficiency in leveraging Gen AI models using APIs/SDKs.
- Expertise in cloud data lakehouse platforms such as AWS Data Lake, Databricks, or Hadoop.
- Proficiency in relational data stores like Postgres, Oracle, or similar, and NoSQL data stores like Cassandra, DynamoDB, or MongoDB.
- Advanced proficiency in Cloud Data Warehouses such as Snowflake or AWS Redshift.
- Experience with scheduling/orchestration tools like Airflow or AWS Step Functions.
- Proficiency in Unix scripting, data structures, and data serialization formats like JSON, AVRO, or Protobuf.
- Knowledge of big-data storage formats such as Parquet or Iceberg.
- Familiarity with data processing methodologies like batch, micro-batching, or streaming.
- Experience with data modeling techniques such as Dimensional, Data Vault, Kimball, or Inmon.
- Understanding of Agile methodology, TDD/BDD, and CI/CD tools.
Preferred Qualifications:
- Knowledge of data governance and security best practices.
- Experience in conducting data analysis to support business insights.
- Strong expertise in Python and Spark.
Benefits & conditions
At PTR Global, we understand the importance of your privacy and security. We NEVER ASK job applicants to:
- Pay any fee to be considered for, submitted to, or selected for any opportunity.
- Purchase any product, service, or gift cards from us or for us as part of an application, interview, or selection process.
- Provide sensitive financial information such as credit card numbers or banking information. Successfully placed or hired candidates would only be asked for banking details after accepting an offer from us during our official onboarding processes as part of payroll setup.
Pay Range: $65 - $70
The specific compensation for this position will be determined by a number of factors, including the scope, complexity and location of the role as well as the cost of labor in the market; the skills, education, training, credentials and experience of the candidate; and other conditions of employment. Our full-time consultants have access to benefits including medical, dental, vision and 401K contributions as well as any other PTO, sick leave, and other benefits mandated by appliable state or localities where you reside or work.
