> Markdown version of [/jobs/ext/1319792-etl-data-engineer](https://www.wearedevelopers.com/jobs/ext/1319792-etl-data-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # ETL Data Engineer - **Company:** Hamilton Lane Advisors, Inc. - **Location:** United States - **Contract:** Permanent contract - **Skills:** Agile Methodology, Microsoft Azure, Big Data, Software as a Service, Cloud Database, Cloud Storage, Databases, Continuous Integration, Information Engineering, Data Governance, Data Infrastructure, Data Integration, Extract Transform Load (ETL), Data Security, Data Sharing, Data Systems, Data Visualization, Data Warehousing, Relational Databases, Database Queries, DevOps, Dimensional Modeling, Python (Programming Language), Key Management, Machine Learning, Performance Tuning, Power BI, Standard Sql, Azure Data Lake, SQL Stored Procedures, SQL Databases, Data Streaming, Systems Integration, Tableau (Software), Enterprise Data Management, Cloud Platform System, Data Ingestion, Azure Data Factory, Snowflake, Git, Data Lakes, Pyspark, Semi-structured Data, Information Technology, Data Management, Restful APIs, Terraform, Data Pipelines, Serverless Computing - **Published:** July 17, 2026 - **Apply:** https://www.dice.com/job-detail/085d3f4c-82c3-4587-a913-c6449541d5a2 ## About the Role * Bachelor's degree in Computer Science, Information Technology, Data Engineering, or a related field; or equivalent professional experience. * Relevant certifications such as SnowPro, Azure Data Engineer Associate, or other cloud data platform certifications are a plus. * Proven experience developing data pipelines that extract, transform, and load data from REST APIs, relational databases, cloud storage, and flat-file sources. * Demonstrated experience working with Snowflake features including virtual warehouses, streams, tasks, stages, Snowpipe, secure data sharing, and performance optimization. * Advanced SQL development skills with the ability to write complex queries, tune performance, and optimize large-scale data workloads. * Experience with data modeling techniques including dimensional modeling, star schemas, fact tables, and dimension tables. * Familiarity with cloud-based data ecosystems and integration services, particularly within Microsoft Azure. * Experience managing source code and CI/CD pipelines using Git and Azure DevOps or similar platforms. * Knowledge of data integration best practices, data governance frameworks, and enterprise data management principles. * Strong analytical and problem-solving skills with exceptional attention to detail. * Excellent verbal and written communication skills and the ability to work collaboratively in a fast-pace environment with evolving priorities. * Experience with big data technologies, machine learning, data science platforms, or advanced analytics is preferred. * Experience with data visualization tools such as Power BI, Tableau, or similar platforms is a plus. * Familiarity with Agile delivery methodologies and DevOps practices is desirable. Preferred Technologies * Snowflake * Python/PySpark * SQL * Azure Data Lake Storage (ADLS) * Azure Data Factory (or equivalent orchestration tools) * Azure Key Vault * Git/Azure DevOps * Power BI * REST APIs * CI/CD and Infrastructure ad Code (Terraform preferred) ## Description As an ETL Data Engineer, you will play a critical role in our expanding data engineering team. You will be responsible for designing, developing, and maintaining scalable data integration solutions primarily using Python (PySpark), Snowflake, and modern cloud data platform technologies, ensuring the accuracy, reliability, and availability of data for analytics and business decision-making. You will work closely with data architects, data scientists, analysts, and business stakeholders to deliver high-quality, well-structured data products that support advanced analytics, reporting, and operational use cases. If you are passionate about data engineering, enjoy building modern cloud data platforms, and are eager to leverage Snowflake's capabilities to drive business value, we'd love to hear from you. Your responsibilities will be to: Data Engineering & ETL Development * Design, develop, and maitain scalable ETL/ELT data pipelines using Python (PySpark), Snowflake, and cloud-native integration technologies. * Build reliable, efficient, and reusable data ingestion, transformation, and loading processes to support enterprise analytics and reporting needs. Snowflake Data Platform * Utilize Snowflake's architecture and capabilities to design, build, and optimize modern cloud data solutions. * Implement and manage Snowflake objects including databases, schemas, tables, views, streams, tasks, stages, and stored procedures. * Leverage Snowflake features such as virtual warehouses, data sharing, time travel, and automated scaling to maximize performance and cost efficiency. Data Warehousing * Apply expertise in dimensional modeling, star schemas, facts, and dimensions to design and implement scalable enterprise data warehouse solutions within Snowflake. * Develop data models that balance business requirements, performance, and maintainability. Data Source Integration * Extract and ingest data from a variety of sources including REST APIs, relational databases, SaaS applications, flat files, and cloud storage platforms. * Develop and maintain robust ingestion frameworks supporting structured and semi-structured data formats. Cloud Data Architecture * Contribute to the design and implementation of modern data platform concepts including data lakes, lakehouses, data mesh architectures, and enterprise data catalogs. * Support integration between Snowflake and cloud-native services across Azure and other cloud platforms. Data Modeling & Design * Collaborate with data architects and business stakeholders to develop logical and physical data models aligned with business objectives. * Establish and enforce data engineering standards and best practices. Data Quality & Governance * Implement automated data quality controls, validation frameworks, and monitoring processes to ensure accuracy, consistency, and completeness. * Support data governance initiatives and maintain adherence to organizational standards. Performance Optimization * Monitor and optimize Snowflake workloads, ETL/ELT processes, and SQL queries to meet performance objectives and service-level agreements. * Analyze warehouse utilization and recommend improvements to performance and cost efficiency. Monitoring & Troubleshooting * Monitor data pipelines and platform operations, diagnose data and performance issues, and implement long-term solutions to ensure reliability and availability. * Support production environments and participate in incident resolution activities. Documentation * Maintain comprehensive documentation for data pipelines, data flows, transformations, data models, and operational processes. Collaboration * Partner with cross-functional teams to understand business requirements and provide technical expertise on data-related initiatives. Security & Compliance * Ensure data security, privacy, and regulatory compliance through the implementation of appropriate access controls, masking policies, governance frameworks, and industry best practices. ## Related Videos - [PySpark - Combining Machine Learning & Big Data](https://www.wearedevelopers.com/videos/44-pyspark-combining-machine-learning-big-data) - [From DevOps to Scaled DevOps: How We’re Rebuilding Continuous Delivery as a Platform](https://www.wearedevelopers.com/videos/100018-from-devops-to-scaled-devops-how-we-re-rebuilding-continuous-delivery-as-a-platform) - [How a Small Team Shrank a Microsoft Monorepo by 94%](https://www.wearedevelopers.com/videos/1236-how-a-small-team-shrank-a-microsoft-monorepo-by-94) - [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works) - [Data Science in Retail](https://www.wearedevelopers.com/videos/586-data-science-in-retail) - [Empowering Retail Through Applied Machine Learning](https://www.wearedevelopers.com/videos/976-empowering-retail-through-applied-machine-learning) ## Related Articles - [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk) - [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story) - [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know) - [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers) - [What Are The Top Skills Required For Azure Developers?](https://www.wearedevelopers.com/magazine/77-what-are-the-top-skills-required-for-azure-developers) - [Data Analyst Salary in the UK](https://www.wearedevelopers.com/magazine/278-data-analyst-salary-in-the-uk)