Data Engineer
MAGNUS MANAGEMENT GROUP, LLC
United States
about 1 month ago
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Experienced
Experience required
3 years minimum
Working hours
Regular working hours
Job source
Tech stack
Microsoft Excel
Application Programming Interfaces (APIs)
Cloud Computing
Data Architecture
Information Engineering
Data Governance
Extract Transform Load (ETL)
Database Queries
Fraud Prevention and Detection
Graph Database
JSON
Python (Programming Language)
+9 more
Microsoft SQL Server
SQL Azure
Standard Sql
Data Streaming
Unstructured Data
Extensible Markup Language (XML)
Enterprise Data Management
Data Management
Databricks
Job description
Seeking a Data Engineer responsible for designing, developing, and maintaining scalable enterprise data pipelines supporting advanced fraud analytics. The candidate will manage ingestion, transformation, quality control, and optimization of structured and unstructured data across cloud-based analytics platforms.
Requirements
- Should bring a minimum of three (3) years of professional experience in data engineering or a related field.
- Demonstrate the ability to design, build, and maintain scalable ETL pipelines across diverse data sources.
- Should apply strong SQL and Python skills, or equivalent technologies, to ingest and transform data from flat files, JSON, XML, Excel, APIs, graph databases, with flexibility to adapt to additional formats and sources as needed.
- Should possess experience loading, managing, and optimizing data within platforms such as Databricks Unity Catalog and SQL Server managed instances, including work with streaming and batch ingestion frameworks and modern Lakehouse architecture.
- Should exhibit strong capabilities in implementing standard quality control processes to ensure data quality, lineage, reliability, and performance while collaborating effectively with cross-functional teams.
- Must have familiarity with data governance, data quality, and data management practices consistent with enterprise data management (EDM) standards.
- Must have experience supporting fraud detection, anomaly detection, or financial oversight analytics environment preferred., * Minimum 3 years data engineering experience.
- Strong SQL skills.
- Strong Python programming.
- Experience building ETL pipelines.
- Experience with Databricks.
- Experience with Azure SQL or SQL Server.
- Experience implementing data quality processes., * Experience with fraud detection analytics.
- Experience with streaming data pipelines.
- Experience supporting enterprise data governance.
Benefits & conditions
Pulled from the full job description
- 401(k)
- Health insurance
- Paid time off
- Vision insurance
- Dental insurance, * 401(k)
- Dental insurance
- Health insurance
- Paid time off
- Vision insurance
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Apply on www.indeed.comGood distractions
Talks and stories from around this role — technically off-topic, practically not.
Moments
Explore playlistsVideos
See allRelated articles
See all
EM
Eli McGarvie
about 3 years ago
EM
Eli McGarvie
Data Analyst Salary in the UK
about 3 years ago
EM
Eli McGarvie
Highest Paying Tech Companies for Developers
over 3 years ago
DS
Dhannush Subramani
Top Big Data Technologies That You Need to Know
about 4 years ago
LM
Luis Minvielle
How to Become an AI Engineer
over 2 years ago
LM
Luis Minvielle
The Most Popular IT Jobs on the Market
over 2 years ago