Data Engineer - Quincy, MA (Onsite) - 12+ Months

TMS LLC

Quincy, MA, United States

18 days ago

Apply on www.careerjet.com

Prepare application

Role details

Contract type

Permanent contract

Employment type

Full-time (> 32 hours)

Experience level

Expert

Experience required

8 years minimum

Compensation

$127,300.0 - $165,500.0

Working hours

Regular working hours

Job source

www.careerjet.com

Tech stack

Application Programming Interfaces (APIs) Amazon Web Services Amazon S3 Batch Files Data as a Services Data Architecture Information Engineering Data Integration Data Transformation Distributed Computing Environment Event-Driven Programming Identity and Access Management

+19 more

Java Database Connectivity JSON Machine Learning Standard Sql Search Technologies Unstructured Data Parquet Data Processing Feature Engineering Apache Spark Generative AI Data Lakes Pyspark AWS Glue Machine Learning Operations Restful APIs Artificial Intelligence Markup Language (AIML) Data Pipelines Databricks

Job description

This role will be responsible for developing data pipelines integrating data from multiple internal and external sources and creating trusted datasets that support analytics reporting and AIML driven insights across the Real Estate organization, Overview: The Sr. Project Engineer role will oversee and execute the project controls and management of a multiple discipline, EPC project focused in the Mining Industry. Your ma…
2 days ago, Job Description: Saab Inc., Autonomous and Undersea Systems division is seeking an innovative and experienced Senior Staff Electrical Engineer to support our growing team working…
3 days ago +

Requirements

The ideal candidate combines strong hands-on data engineering skills with experience in cloud native architectures largescale data processing and modern lakehouse platforms, * Data Engineering
Strong experience building ETLELT pipelines
Proficiency in Python PySpark and SQL
Experience working with Apache Spark and distributed data processing frameworks
Knowledge of data modeling data quality and data transformation techniques
Databricks
Handson experience with the Databricks Lakehouse Platform
Experience with Delta Lake Databricks Workflows and Unity Catalog
Ability to develop optimize and troubleshoot Databricks notebooks and jobs
AWS
Experience with AWS data services such as
Amazon S3
AWS Glue
Lambda
IAM
Event driven integrations and APIs
Understanding of cloudnative data architecture patterns
Data Integration
Experience integrating data through REST APIs JDBC connections batch file transfers or streaming mechanisms
Familiarity with structured semi structured and unstructured data formats including JSON CSV and Parquet
AIML Advanced Analytics
Experience preparing and engineering datasets for machine learning and AI workloads
Understanding of AIML concepts feature engineering and model lifecycle processes
Exposure to Databricks ML MLflow vector search or Generative AI capabilities is a plus
Ability to collaborate with business teams to identify opportunities for predictive analytics trend analysis document intelligence and operational insights

About the company

Job Description: Established nearly two centuries ago, FM is a leading mutual insurance company whose capital, scientific research capability and engineering expertise are solely…