Azure Data/Search Engineer

Peoplentech Llc
Alexandria, VA, United States
14 days ago
Apply on www.thejobnetwork.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
8 years minimum
Working hours
Regular working hours

Tech stack

Application Programming Interfaces (APIs) Artificial Intelligence Application Services Microsoft Azure Big Data Mobile Application Development Cloud Computing Cloud Computing Security Cloud Engineering Code Review Databases Information Engineering
+47 more
Extract Transform Load (ETL) Relational Databases Linux DevOps Distributed Systems Elasticsearch JSON Python (Programming Language) Key Management PostgreSQL Machine Learning Microsoft SQL Server OpenAI Search Technologies Software Deployment Software Engineering SQL Databases Data Streaming Enterprise Search Enterprise Data Management Data Logging Pulumi Enterprise Software Applications Data Ingestion Azure Data Factory Cloud Monitoring GitHub Copilot Large Language Models Indexer Backend Git Fastapi Event Driven Architecture Data Lakes Pyspark Low Latency Deployment Automation Apache Kafka Restful APIs Terraform Data Pipelines Atlassian Bamboo Docker Container Apps Confluent Databricks Microservices

Job description

Looking for a strong Azure Data Engineer / Senior Software Engineer with strong expertise in Python, Databricks, SQL, Elasticsearch, Kafka, and Azure, responsible for building scalable search platforms, REST APIs, event-driven data pipelines, and cloud-native distributed systems supporting high-volume enterprise applications.

Roles and Responsibilities: -

Β· Resource will be responsible to design, build, and support client, our enterprise search and intelligent matching platform.

Β· This role will develop scalable APIs, high-performance search capabilities, event-driven data pipelines, and cloud-native services supporting millions of transactions daily.

Β· The consultant will work across Azure, Elasticsearch, Kafka, Databricks, Python, and distributed systems to build highly available, low-latency applications

Β· The ideal candidate has strong backend engineering experience with cloud-native architectures, search technologies, REST APIs, event streaming, and large-scale data processing.

Β· Design and develop scalable backend services using Python. Build and maintain REST APIs supporting enterprise applications. Design and optimize Elasticsearch indexes, queries, mappings, and search relevance.

Β· Develop intelligent search and matching capabilities for large-scale datasets. Build event-driven architectures using Kafka and Azure Event Hub. Design high-throughput data ingestion and indexing pipelines. Integrate applications with Databricks and enterprise data platforms.

Β· Develop secure cloud-native applications on Microsoft Azure. Implement CI/CD pipelines and automated deployment processes.

Β· Monitor application health, logging, observability, and production performance. Optimize API response time, indexing performance, and infrastructure utilization. Participate in architecture, design reviews, code reviews, and production support.

Β· Collaborate with product managers, architects, data scientists, and engineering teams.

Requirements

Engineering Degree - BE/ME/BTech/MTech/BSc/MSc.

Technical certification in multiple technologies is desirable.

Required Experience / Skills :

  • Programming Python (required) SQL REST APIs JSON FastAPI (preferred) Async Python Cloud Microsoft Azure Azure App Services Azure Linux VMs Azure Container Apps / AKS (preferred) Azure Managed Identity, Azure Key Vault, Azure Storage, Azure Monitor, Azure Event Hub Search

  • Technologies Elasticsearch Query DSL Relevance tuning Mapping design Aggregations Multi-search (msearch) Bulk indexing Search optimization Index lifecycle management Event Streaming Apache Kafka Confluent Cloud Producers / Consumers Kafka Connect Schema Registry

  • Event-driven architecture Data Engineering Databricks PySpark Delta Lake Data ingestion pipelines ETL/ELT DevOps Git Azure DevOps Azure Pipelines CI/CD Docker Infrastructure as Code (Terraform or Pulumi preferred) - Databases PostgreSQL SQL Server Relational Databases Required

  • Experience Min 8 years of software engineering experience.

  • Strong Python backend development experience.

  • Experience designing and operating production REST APIs.

  • Strong experience with Elasticsearch in production environments.

  • Experience building scalable search platforms. Experience with Kafka or enterprise event-streaming platforms.

  • Experience deploying applications on Microsoft Azure experience with CI/CD pipelines and automated deployments.

  • Experience troubleshooting production systems and performance issues.

  • Strong understanding of distributed systems and microservices.

Preferred Qualifications:

Β· Experience with AI-assisted search or intelligent matching platforms. Experience with Databricks and Delta Lake.

Β· Experience with machine learning integration. Experience with semantic search or vector search.

Β· Experience with Azure OpenAI or LLM integration. Healthcare or supply chain experience. Experience using GitHub Copilot or Codex.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.thejobnetwork.com
Prepare application

Good distractions

Loading talks and stories from around this role…