Senior Data Engineer

Reply Inc
Atlanta, KS, United States
about 2 months ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
3 years minimum
Working hours
Regular working hours
Job source

Tech stack

Application Programming Interfaces (APIs) Artificial Intelligence Automation of Tests Microsoft Azure Cloud Database Databases Information Engineering Data Governance Data Infrastructure Data Transformation Data Security Data Sharing
+28 more
Data Systems Data Warehousing DevOps Distributed Computing Environment Github Apache Hive Python (Programming Language) PostgreSQL SQL Azure Power BI SQL Databases Data Streaming Workflow Management Systems Enterprise Software Applications Data Ingestion Azure Data Factory Apache Spark IT Architecture Microsoft Fabric Data Lakes Pyspark Information Technology Data Analytics Cosmos DB Data Management Tools for Reporting Docker Databricks

Job description

We are seeking a Data Engineer to design, build, and optimize modern data platforms for our clients using Microsoft Azure, Microsoft Fabric, Power BI, and Databricks. This role requires both deep technical expertise and strong consulting skills to translate business needs into scalable solutions and communicate effectively with all stakeholders. You will help architect and deliver high-quality data solutions that drive measurable business value., * Work directly with clients to understand business goals, data challenges, and technical requirements.

  • Lead or support discovery sessions, requirements workshops, architecture discussions, and solution reviews.
  • Develop and optimize batch and streaming data ingestion pipelines from enterprise applications, databases, APIs, and file-based sources.
  • Implement medallion/lakehouse architectures, dimensional models, and data transformation workflows to support analytics and reporting use cases.
  • Engineer solutions using technologies such as PySpark, Spark SQL, SQL, Python, Delta Lake, and orchestration tools within Azure and Databricks.
  • Recommend best practices for data modeling, governance, lineage, monitoring, DevOps, and security.

Requirements

Do you have experience in Infrastructure architecture design?, Do you have a Bachelor’s degree?, * Bachelor’s degree in computer science or related field

  • 6+ years of experience in data engineering, data platform development, or cloud data solutions
  • 3+ years of hands-on experience with Azure Databricks, Apache Spark, or similar distributed data processing technologies
  • Expertise with Microsoft Azure infrastructure and data resources, including Fabric, Azure Data Factory, Synapse Data Analytics, Power BI, Azure SQL, Azure Cosmos DB, and Azure Database for PostgreSQL
  • Expertise with Databricks, specifically the ability to design enterprise-level strategy and architecture including Unity Catalog, data warehousing, data sharing, and Mosaic AI .
  • DevOps for data, GitHub, automated testing, and working with containers (AKS, Docker, registries, etc.)
  • Excellent communication skills, ability to clearly explain concepts to teammates and customers, and quickly learn new concepts and technologies, * Experience working directly with clients, business stakeholders, or cross-functional teams in a consulting or professional services environment.
  • Experience building data agents, including NLQ, Databricks Genie, and Fabric Data Agents
  • Experience with data management, including data governance, data security, master data management, and familiarity with different industry security requirements
  • Broad experience with data/reporting tools, architectures, cloud vendors, and data/AI concepts other than Microsoft

About the company

Valorem Reply is an award-winning digital transformation firm focused on delivering solutions around data-driven enterprise, IT modernization, customer experience, product transformation and digital workplace by leveraging the power of Microsoft technologies. We provide hyper-scale and agile delivery of unique digital business services, strategic business models and design-led user experiences. Our innovative strategies and solutions securely and rapidly transform the way our clients do business., Reply specializes in the design and implementation of solutions based on new communication channels and digital media. Reply is a network of highly specialized companies supporting global industrial groups operating in the telecom and media, industry and services, banking, insurance and public administration sectors in the definition and development of business models enabled for the new paradigms of AI, cloud computing, digital media and the Internet of Things. Reply services include Consulting, System Integration and Digital Services.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on indeed.com

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

3:03 min

Career evolution in data engineering and AI platforms

Maria Apazoglou · Coffee With Developers

2:07 min

Inspecting default bridge architectures and custom Docker networks

Oliver Seitz Oliver Seitz · WWC 2025

6:36 min

Funding open source through GitHub Accelerator and Sponsors

Stormy Peters · WWC 2023

2:17 min

Mapping the maturity roadmap for scaled devops adoption

Dominik Krichbaum Dominik Krichbaum · WWC Europe 2026

2:57 min

Core technical practices for robust data engineering

Sandhya Menon Sandhya Menon · WWC Europe 2026

2:34 min

Docker sandbox architecture and microVM environment integration

Manuel de la Peña Manuel de la Peña · WWC Europe 2026

Videos

See all

Related articles

See all