> Markdown version of [/jobs/ext/4323874-data-lake-engineer](https://www.wearedevelopers.com/jobs/ext/4323874-data-lake-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Data Lake Engineer - **Company:** Prescient Edge - **Location:** Doral, FL, United States - **Contract:** Permanent contract - **Skills:** Artificial Intelligence, Amazon Web Services, Systems Engineering, Microsoft Azure, Big Data, Cloud Computing Security, Cloud Engineering, Data as a Services, Data Architecture, Data Governance, Extract Transform Load (ETL), Data Transformation, Data Security, Graph Database, Identity and Access Management, Python (Programming Language), NoSQL, Performance Tuning, Role-Based Access Control, SPARQL, SQL Databases, Unstructured Data, Google Cloud, Cloud Platform System, Apache Spark, Git, Data Lakes, Information Technology, Deployment Automation, Data Analytics, Data Lakehouse, Cloud Integration, Terraform, Software Version Control, Data Pipelines, Devsecops, Databricks - **Published:** October 31, 2026 - **Apply:** https://www.adzuna.com/details/5746130652 ## About the Role * Possess the knowledge and capability to support Data Lake platform administration and enterprise data architecture for DoD data-driven projects. * Skilled in Data Lake Platform administration, including workspace management, cluster optimization, and Unity Catalog integration for secure data governance. * Proficient in ETL pipeline development, Delta Lake architecture, and Data Lakehouse optimization for DoD analytics and mission critical data workflows. * Experienced in SysEngOps, DevSecOps, version control systems (Git), and CI/CD pipelines to streamline Data Lakedevelopment and deployment. * Knowledgeable in identity and access management (IAM), role-based access control (RBAC), and cloud security best practices across AWS, Azure, and GCP. * Hands-on expertise in Python, SQL/NoSQL, Apache Spark, Databricks SQL, Terraform, and cloud native data services for large-scale data processing and analytics. * Has strong background in: + Databricks platform administration, including workspace configuration, Unity Catalog, cluster performance tuning, and cloud integration. + Data pipeline development (ETL/ELT), Delta Lake optimization, and AI/ML workflow integration. + SysEngOps, DevSecOps, version control systems (Git), and CI/CD pipelines for automated deployment and governance. + Cloud security, role-based access control (RBAC), and compliance with DoD data policies across AWS, Azure, and GCP., * A Master's degree or higher (e.g. Ph.D.) in Computer Science, Information Technology, Systems Engineering, Data Science, Business Administration, Engineering Management, or a closely related field; or a minimum of 11+ years of experience managing complex technical projects in enterprise data architecture, Databricks administration, and cloud-based data platforms. ## Description * Design, implement, and maintain scalable Data Lake architectures to support structured and unstructured data ingestion, ensuring efficient data access and retrieval. * Configure and manage the integration interface between the Data Lake and the managed knowledge graph platform (Stardog), including SPARQL endpoint access, metadata federation, and catalog alignment. * Follow access control policies and usage scope. * Confirm compliance with access policies on a quarterly basis and document the results in the Data Governance & Compliance Report. * Optimize ETL pipelines for high-volume data transformation, ensuring compliance with DoD IL-4/IL-5 security standards * Implement storage tiering strategies and access controls, ensuring data is properly classified, retained, and accessed per DoD governance requirements. * Submit the Data Lake Performance & Optimization Report, detailing ingestion efficiency, access control improvements, and storage utilization metrics.