> Markdown version of [/jobs/ext/736226-lead-data-engineer](https://www.wearedevelopers.com/jobs/ext/736226-lead-data-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Lead Data Engineer - **Company:** Kforce Inc. - **Location:** Miami, FL, United States - **Experience:** Expert - **Contract:** Permanent contract - **Skills:** Application Programming Interfaces (APIs), Artificial Intelligence, Amazon Web Services, Amazon Elastic Compute Cloud, Amazon S3, ARM Architecture, Audit Trail, Automation of Tests, Cloud Computing, Cloud Engineering, Code Generation, Continuous Integration, Data Cleansing, Data Infrastructure, Extract Transform Load (ETL), Data Sharing, Cursor (Graphical User Interface Elements), Programming Tools, Identity and Access Management, Python (Programming Language), Object-Oriented Software Development, DataOps, Data Streaming, Data Processing, Cloud Platform System, Macros, Data Ingestion, GitHub Copilot, System Availability, Large Language Models, Snowflake, Data Build Tool (dbt), Generative AI, AWS ECS, Data Layers, Modularization, Containerization, AI Platforms, Data Analytics, Machine Learning Operations, Functional Programming, Cloudwatch, GPT, Software Version Control, Data Pipelines - **Published:** June 29, 2026 - **Apply:** https://www.dice.com/job-detail/9558a474-4902-4c7c-8d1c-fab502fe28a1 ## About the Role Strong Technical Experience (3+ to 6+ years) with: * Advanced Python Development: Writing clean, object-oriented, and production-grade Python code for complex data manipulation, automation, and API communication * AWS Platform & Containerization: Hands-on experience deploying, managing, and scaling containerized data workloads using AWS ECS (Elastic Container Service) and ECR; Core AWS architecture: S3, IAM, Lambda, EC2, CloudWatch, and CloudTrail; AWS Certification is a strong plus * Snowflake Data Cloud: Account administration, optimal virtual warehouse clustering strategies, and budget-optimization; Expert feature implementation: Data Sharing, Time Travel, and Zero-copy cloning * dbt (Data Build Tool): Managing multi-repository dbt projects and configuring dbt Cloud environments; Creating, documenting, and optimizing advanced dbt models and custom macros * AI-Assisted Engineering & Data Tools: Daily proficiency with AI coding assistants (GitHub Copilot, Cursor, or Claude/OpenAI APIs) to maximize development efficiency; Familiarity with cloud-native AI services (e.g., Snowflake Cortex or AWS Bedrock) for embedding LLM capabilities directly inside the data layer; Exposure to frameworks used for AI data preparation (e.g., LangChain, Vector Databases, or text embedding generation) ## Description Kforce has a client that is seeking a Lead Data Engineer in Miami, FL., The Lead Data Engineer role is to help our business evolve into a data and insights-driven organization. You will provide technical leadership to our data platform engineering team. This is done by helping design and implement our next generation data and analytics platforms and products using Data Engineering best practices. Responsibilities: * Design, Build, and Operationalize: Formulate production-grade data engineering solutions for the data and analytics platforms and products * Pipeline Architecture: Architect and implement reliable ETL, ELT, and streaming data ingestion/delivery processes across multiple enterprise sources * Modern Python Development: Develop, maintain, and containerize modular data applications and utility scripts using Python, leveraging modern cloud infrastructure * Scale and Improve Infrastructure: Improve data ingestion architecture, emphasizing data quality, cost-performance, maintainability, and extensibility across storage and compute layers * Enforce Standards and Downstream Integrity: Define and implement engineering standards for the data team (including code modularization, version control, automated testing, and secure CI/CD workflows); Ensure strict guidelines for schema evolution to safeguard downstream analytics from unilateral changes * Platform Observability: Instrument data analytics platforms with robust metrics, alerting, and automated monitoring (SLAs/SLOs) to ensure high availability and data trustworthiness * AI-Driven Productivity: Leverage modern AI-assisted development tools within daily engineering workflows to accelerate code generation, optimize heavy queries, and improve overall delivery speed * AI/ML Integration: Collaborate with data science teams to design and optimize data layers specifically tailored for Generative AI applications, Retrieval-Augmented Generation (RAG), and LLM frameworks ## Related Videos - [Alibaba Big Data and Machine Learning Technology](https://www.wearedevelopers.com/videos/37-alibaba-big-data-and-machine-learning-technology) - [Crafting Custom Frameworks with Rust: A Deep Dive into Procedural Macros](https://www.wearedevelopers.com/videos/849-crafting-custom-frameworks-with-rust-a-deep-dive-into-procedural-macros) - [ Evaluating AI models for code comprehension](https://www.wearedevelopers.com/videos/1462-evaluating-ai-models-for-code-comprehension) - [Enjoying SQL data pipelines with dbt](https://www.wearedevelopers.com/videos/823-enjoying-sql-data-pipelines-with-dbt) - [Modularity: Let's dig deeper](https://www.wearedevelopers.com/videos/1200-modularity-let-s-dig-deeper) - [Streaming AI Responses in Real-Time with SSE in Next.js & NestJS](https://www.wearedevelopers.com/videos/1630-streaming-ai-responses-in-real-time-with-sse-in-next-js-nestjs) ## Related Articles - [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers) - [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story) - [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know) - [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk) - [Dev Digest 120 - Apple and peers](https://www.wearedevelopers.com/magazine/455-dev-digest-120-apple-and-peers) - [Dev Digest 132 - Binging WADFlix?](https://www.wearedevelopers.com/magazine/473-dev-digest-132-binging-wadflix)