Senior Data Engineer (Azure Data Factory Databricks, PostgreSQL, Python) -(USC or GC only) - Local candidates only
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Tech stack
+37 more
Job description
- Design, build, and maintain scalable production data pipelines supporting enterprise data platforms
- Perform exploratory data analysis, statistical analysis, and data validation to support analytics and reporting
- Develop and optimize ETL/ELT workflows including job design, orchestration, and performance tuning
- Build and maintain relational database schemas, queries, and stored procedures
- Work within Azure-based data environments including Data Factory, Databricks, and Data Lake Storage
- Collaborate with analytics, BI, and engineering teams to deliver reliable data products
- Implement monitoring, logging, and observability for data pipelines
- Maintain documentation, data lineage, and governance standards
- Participate in architecture discussions and contribute to long-term data platform strategy
Requirements
NOTE: This is a full time position and this person must be a Green Card Holder or be a US Citizen of the United States, as per the company, due to government compliance.
Must have the following: Azure Data Factory, Databricks, Python, SQL, ETL/ELT pipelines, Data Lake, Spark, Data Engineering, Cloud Data Platforms, CI/CD, * Bachelor’s degree in Computer Science, Statistics, Mathematics, Information Science, Data Engineering, Finance, or related field (Master’s preferred)
- 5+ years of data engineering experience working with production data pipelines
- 5+ years of applied data analysis and statistical data work
- 3+ years of ETL / ELT development experience
- 3+ years working with relational databases and performance tuning
- Experience with Azure data services (Data Factory, Databricks, Data Lake, Synapse, Delta Lake, or similar)
- Strong programming experience with Python, PySpark, SQL, and Bash
- Experience with Kafka, SAP data services, or similar integration tools preferred
- Experience with PostgreSQL, SAP ASE, or comparable databases
- Experience with Power BI or BusinessObjects is a plus
- Experience with CI/CD pipelines, Git, Kubernetes, and infrastructure-as-code
- Knowledge of data governance, cataloging, and access control
- Experience with monitoring tools such as Datadog, Grafana, or Prometheus
- Ability to work independently while managing multiple priorities
- Strong communication and documentation skills
- Must be eligible to work in the United States
INDH Senior Data Engineer, Azure Data Factory, Databricks, Python, SQL, ETL, ELT, Data Pipelines, Data Lake, Spark, Delta Lake, Azure Synapse, Cloud Data Platform, Data Engineering, Big Data, Kafka, PostgreSQL, SAP Data Services, Power BI, CI/CD, Kubernetes, Data Governance, Data Lineage, Analytics Engineering, Data Integration, Financial Data, Enterprise Data, Data Architecture, BI Reporting, PySpark, Bash, Cloud Engineering, Data Warehouse, Data Modeling, Observability, Grafana, Prometheus, Datadog, Azure Cloud, Data Platform Engineer, Statistical Analysis
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Good distractions
Talks and stories from around this role — technically off-topic, practically not.
Moments
Explore playlistsVideos
See allRelated articles
See all
Data Analyst Salary in the UK
The Most Popular IT Jobs on the Market
Highest Paying Tech Companies for Developers
Top-Paying Tech Jobs (with Salaries)