Data Engineer

VANTAGE AI CORPORATION
Vienna, VA, United States
19 days ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
4 years minimum
Compensation
$110,000.0 - $125,000.0
Working hours
Regular working hours
Job source

Tech stack

Application Programming Interfaces (APIs) Microsoft Azure Big Data Business Software Information Engineering Data Governance Data Infrastructure Extract Transform Load (ETL) Data Transformation Data Warehousing Relational Databases Software Design Patterns
+25 more
Apache Hive Python (Programming Language) Query Optimization Power BI Cloud Services SQL Stored Procedures SQL Databases Data Streaming Workflow Management Systems Scripting Microsoft Power Automate Azure Data Factory Sql Optimization Power Platform Integration Apache Spark Backend Git Data Lakes Pyspark Low-code Azure Synapse Analytics Software Version Control Data Pipelines Powerapps Databricks

Job description

  • Design, develop, and maintain ETL/ELT pipelines using Databricks (PySpark/Spark SQL) for large-scale data processing
  • Build and support business applications, workflows, and automations using Power Apps, Power Automate, and the broader Power Platform
  • Write complex, performant SQL queries, stored procedures, and views across relational databases
  • Develop reusable Python scripts/modules for data transformation, automation, and integration tasks
  • Design and optimize data models and schemas to support analytics and reporting needs
  • Integrate Power Platform solutions with backend data sources (Databricks, SQL databases, APIs)
  • Collaborate with business stakeholders, analysts, and data scientists to translate requirements into technical solutions
  • Ensure data quality, governance, and security best practices across pipelines and applications
  • Monitor, troubleshoot, and optimize existing pipelines and applications for performance and reliability
  • Document technical designs, data flows, and processes for maintainability

Requirements

We are seeking a Senior Data Engineer with strong hands-on expertise in the Microsoft Power Platform ecosystem and Databricks to design, build, and maintain scalable data pipelines and business applications. The ideal candidate combines deep SQL and Python engineering skills with practical experience delivering low-code/pro-code solutions on Power Apps and Power Platform, enabling both robust backend data infrastructure and front-end business tooling., * 6+ years of professional experience in data engineering or a related field

  • Strong hands-on experience with Databricks (Spark, Delta Lake, notebooks, job orchestration)
  • Proven experience building solutions with Power Apps and Power Platform (Power Automate, Power BI is a plus)
  • Advanced SQL skills (query optimization, stored procedures, complex joins/aggregations)
  • Strong Python programming skills for data engineering and scripting
  • Experience with cloud data platforms (Azure preferred, given Power Platform/Databricks integration)
  • Solid understanding of data warehousing concepts, ETL/ELT design patterns, and data modeling
  • Experience working with version control (Git) and CI/CD practices for data pipelines

Preferred Qualifications

  • Experience with Azure Data Factory, Azure Synapse, or similar orchestration tools
  • Familiarity with Power BI for reporting/visualization
  • Experience with Delta Live Tables or Unity Catalog in Databricks
  • Knowledge of data governance, security, and compliance frameworks
  • Experience in an agile development environment

Soft Skills

  • Strong problem-solving and analytical thinking
  • Ability to communicate technical concepts to non-technical stakeholders
  • Self-starter, comfortable working independently and cross-functionally, * Bachelor’s (Required)

Experience:

  • Python: 6 years (Required)
  • ETL: 6 years (Required)
  • SQL: 6 years (Required)
  • Databricks: 4 years (Required)

Benefits & conditions

Pulled from the full job description

  • 401(k)
  • Health insurance
  • 401(k) matching
  • Paid time off
  • Vision insurance, * 401(k)
  • 401(k) matching
  • Health insurance
  • Paid time off
  • Vision insurance

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.indeed.com

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

6:21 min

Investigating push inefficiencies with upstream Git experts

Jonathan Creamer · Coffee With Developers

4:32 min

Harnessing Spark with Python using PySpark and Py4J

Ayon Roy · LIVE

1:52 min

Structuring and scaling the backend engineering team

Stefan Lingler Stefan Lingler +1 · Coffee With Developers

3:03 min

Career evolution in data engineering and AI platforms

Maria Apazoglou · Coffee With Developers

56 sec

Favorite git commands and the importance of patch commits

Eileen Uchitelle Eileen Uchitelle +1 · Coffee With Developers

3:09 min

Balancing data science skillings alongside systems engineering rigor

Nico Schmidt · LIVE

Videos

See all

Related articles

See all