Senior ETL Data Engineer
Macpower Digital Assets Edge LLC
Washington, DC, United States
4 days ago
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Apply on www.thejobnetwork.com
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
5 years minimum
Working hours
Regular working hours
Job source
Tech stack
Airflow
ArcGIS (Software)
Microsoft Azure
Backup Devices
Cloud Database
Data Architecture
Data Governance
Extract Transform Load (ETL)
Data Security
Data Warehousing
IBM DB2
Relational Databases
+23 more
Database Queries
PostgreSQL
Microsoft SQL Server
MicroStrategy
Oracle (Applications)
Cloud Services
Azure Data Lake
SQL Databases
Tableau (Software)
Extensible Markup Language (XML)
Parquet
Scripting
Azure Data Factory
Informatica Powercenter
Data Lakes
Information Technology
Avro
Enterprise Integration
Integration Frameworks
Apache Nifi
Azure Synapse Analytics
Data Pipelines
Databricks
Job description
Job Description Position Summary: The Senior ETL Data Engineer supports cloud data operations by designing, developing, and deploying enterprise-level Extract, Transform, Load (ETL) data pipelines. This role curates, processes, and standardizes data across cloud and on-premise platforms while maintaining enterprise data governance, security, and quality standards. Key Responsibilities:
- Designs, develops, tests, and supports complex end-to-end data pipelines to ingest data from multiple sources into target tables and landing layers.
- Establishes and manages connectivity between cloud and on-premise environments using platforms such as Azure Data Lake Storage (ADLS) Gen2, Blob Storage, Azure Data Factory, Synapse, and Databricks.
- Automates, monitors, and optimizes existing data workflows to ensure system performance, data accuracy, security, and scalability.
- Consults with business units and technical teams to gather requirements, resolve system issues, and evaluate technical feasibility for system enhancements.
- Develops database queries, complex scripts, and reporting solutions to support enterprise business requirements.
- Implements system change evaluations, backup procedures, and rollback plans to ensure high data reliability.
- Serves as a technical subject matter expert (SME) on enterprise-wide data architecture and data governance best practices.
Requirements
- Education: Bachelor’s degree in Information Technology, Computer Science, or a related field (or equivalent experience).
- ETL & Data Architecture: 10 to 15 years of experience developing end-to-end ETL processes, data architecture, data warehousing, and business intelligence solutions.
- Database & Querying Skills: 10 years of hands-on experience using SQL for relational databases (e.g., Oracle, SQL Server, Postgres, DB2).
- Data Formats: 10 years of experience working with diverse data formats, including relational, text (CSV, XML), and binary formats (Parquet, AVRO).
- Data Governance: 7 years of experience maintaining data governance, data security, and data consistency standards.
- Cloud Solutions: 5 years of hands-on experience with Microsoft Azure tools, including Azure Data Factory, Synapse Analytics, SQL DB, Data Lake Storage Gen2, and Blob Storage.
- Pipeline Integration: 5 years of experience utilizing integration tools such as Informatica PowerCenter, Apache NiFi, Apache Airflow, or FME.
- Core Competencies: Strong written and verbal communication skills with a proven ability to collaborate across multidisciplinary teams and support external partners., * Experience performing advanced data functions using Databricks.
- Familiarity with data visualization and reporting tools such as MicroStrategy, Tableau, or Esri ArcGIS.
- Experience with Python scripting for data pipeline automation.
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Apply on www.thejobnetwork.com
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Good distractions
Loading talks and stories from around this role…