Senior Data Engineer (Azure Data Factory Databricks, PostgreSQL, Python) -(USC or GC only) - Local candidates only

CAREER DEVELOPERS INC
Reston, VA, United States
23 days ago
Apply on www.indeed.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
3 years minimum
Working hours
Regular working hours
Job source

Tech stack

SAP Sybase Adaptive Server Enterprise Data Analysis Microsoft Azure Bash Shell Big Data Cloud Engineering Computer Programming Databases Continuous Integration Data Architecture Data Validation Information Engineering
+37 more
Data Governance Data Infrastructure Data Integration Extract Transform Load (ETL) Data Warehousing Relational Databases Monitoring of Systems Information Sciences Python (Programming Language) PostgreSQL Operational Databases Performance Tuning Power BI Cloud Services Prometheus SAP NetWeaver Data Management SQL Stored Procedures SQL Databases Enterprise Data Management Datadog Data Logging Cloud Platform System Azure Data Factory Grafana Apache Spark Sap Business Objects Git Data Lakes Pyspark Kubernetes Information Technology Data Lineage Integration Frameworks Apache Kafka Azure Synapse Analytics Data Pipelines Databricks

Job description

  • Design, build, and maintain scalable production data pipelines supporting enterprise data platforms
  • Perform exploratory data analysis, statistical analysis, and data validation to support analytics and reporting
  • Develop and optimize ETL/ELT workflows including job design, orchestration, and performance tuning
  • Build and maintain relational database schemas, queries, and stored procedures
  • Work within Azure-based data environments including Data Factory, Databricks, and Data Lake Storage
  • Collaborate with analytics, BI, and engineering teams to deliver reliable data products
  • Implement monitoring, logging, and observability for data pipelines
  • Maintain documentation, data lineage, and governance standards
  • Participate in architecture discussions and contribute to long-term data platform strategy

Requirements

NOTE: This is a full time position and this person must be a Green Card Holder or be a US Citizen of the United States, as per the company, due to government compliance.

Must have the following: Azure Data Factory, Databricks, Python, SQL, ETL/ELT pipelines, Data Lake, Spark, Data Engineering, Cloud Data Platforms, CI/CD, * Bachelor’s degree in Computer Science, Statistics, Mathematics, Information Science, Data Engineering, Finance, or related field (Master’s preferred)

  • 5+ years of data engineering experience working with production data pipelines
  • 5+ years of applied data analysis and statistical data work
  • 3+ years of ETL / ELT development experience
  • 3+ years working with relational databases and performance tuning
  • Experience with Azure data services (Data Factory, Databricks, Data Lake, Synapse, Delta Lake, or similar)
  • Strong programming experience with Python, PySpark, SQL, and Bash
  • Experience with Kafka, SAP data services, or similar integration tools preferred
  • Experience with PostgreSQL, SAP ASE, or comparable databases
  • Experience with Power BI or BusinessObjects is a plus
  • Experience with CI/CD pipelines, Git, Kubernetes, and infrastructure-as-code
  • Knowledge of data governance, cataloging, and access control
  • Experience with monitoring tools such as Datadog, Grafana, or Prometheus
  • Ability to work independently while managing multiple priorities
  • Strong communication and documentation skills
  • Must be eligible to work in the United States

INDH Senior Data Engineer, Azure Data Factory, Databricks, Python, SQL, ETL, ELT, Data Pipelines, Data Lake, Spark, Delta Lake, Azure Synapse, Cloud Data Platform, Data Engineering, Big Data, Kafka, PostgreSQL, SAP Data Services, Power BI, CI/CD, Kubernetes, Data Governance, Data Lineage, Analytics Engineering, Data Integration, Financial Data, Enterprise Data, Data Architecture, BI Reporting, PySpark, Bash, Cloud Engineering, Data Warehouse, Data Modeling, Observability, Grafana, Prometheus, Datadog, Azure Cloud, Data Platform Engineer, Statistical Analysis

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.indeed.com
Prepare application

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

6:21 min

Investigating push inefficiencies with upstream Git experts

Jonathan Creamer · Coffee With Developers

4:32 min

Harnessing Spark with Python using PySpark and Py4J

Ayon Roy · LIVE

10:40 min

Visualizing Prometheus open metrics using custom Grafana dashboards

Stijn Polfliet · LIVE

3:09 min

Balancing data science skillings alongside systems engineering rigor

Nico Schmidt · LIVE

56 sec

Favorite git commands and the importance of patch commits

Eileen Uchitelle Eileen Uchitelle +1 · Coffee With Developers

3:14 min

Structuring career paths and localized data architectures

Ulrich Wurstbauer +1 · LIVE

Videos

See all

Related articles

See all