> Markdown version of [/jobs/ext/2831208-data-engineer](https://www.wearedevelopers.com/jobs/ext/2831208-data-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Data Engineer

- **Company:** Bright Sol
- **Location:** Alpharetta, GA, United States
- **Experience:** Experienced
- **Contract:** Permanent contract
- **Skills:** Artificial Intelligence, Airflow, Apache HTTP Server, Microsoft Azure, Continuous Integration, Information Engineering, Extract Transform Load (ETL), Data Systems, Data Warehousing, Python (Programming Language), Metadata, Standard Sql, Azure Data Lake, Data Streaming, Workflow Management Systems, Snowflake, Apache Spark, Git, Data Lakes, Pyspark, Star Schema, Apache Kafka, Spark Streaming, Data Management, Azure Synapse Analytics, Data Pipelines, Databricks
- **Published:** September 10, 2026
- **Apply:** https://www.dice.com/job-detail/d2e9770c-d917-4a18-9760-b5598c8d17a9

## About the Role

* 3+ years of hands-on Data Engineering experience
 * Strong Python, PySpark, and SQL
 * Hands-on Databricks experience
 * Strong Snowflake experience
 * Azure experience with ADF, ADLS Gen2, Synapse, and Databricks
 * Hands-on Palantir Foundry experience
 * ETL/ELT pipeline development
 * Data modeling - Star Schema / Snowflake Schema
 * Airflow, dbt, or similar orchestration tools
 * Data quality, governance, metadata, and security
 * Git and CI/CD
 * Batch and/or streaming data pipelines

## Description

* Design and develop scalable data pipelines using Palantir Foundry, Databricks, and Snowflake
 * Build ETL/ELT workflows using Python, PySpark, and SQL
 * Develop Azure-based data solutions using ADF, ADLS, Synapse, and Databricks
 * Support enterprise data migration and modernization initiatives
 * Implement data quality, governance, metadata, and lineage
 * Optimize Spark/Databricks workloads and Snowflake queries
 * Develop dimensional data models and analytical datasets
 * Support batch and near-real-time data pipelines
 * Troubleshoot production pipeline, data quality, and performance issues
 * Implement CI/CD and collaborate with data scientists, analysts, and business stakeholders

Preferred / Nice-to-Have

 * Delta Lake / Apache Iceberg
 * Unity Catalog
 * Kafka / Spark Streaming / Azure Event Hubs
 * Snowflake clustering and materialized views
 * IBM WatsonX.data or similar AI data platforms
 * GenAI / RAG / LangChain
 * MCP


## Related Videos

- [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works)
- [PySpark - Combining Machine Learning & Big Data](https://www.wearedevelopers.com/videos/44-pyspark-combining-machine-learning-big-data)
- [Data Science in Retail](https://www.wearedevelopers.com/videos/586-data-science-in-retail)
- [How a Small Team Shrank a Microsoft Monorepo by 94%](https://www.wearedevelopers.com/videos/1236-how-a-small-team-shrank-a-microsoft-monorepo-by-94)
- [Enjoying SQL data pipelines with dbt](https://www.wearedevelopers.com/videos/823-enjoying-sql-data-pipelines-with-dbt)
- [Empowering Retail Through Applied Machine Learning](https://www.wearedevelopers.com/videos/976-empowering-retail-through-applied-machine-learning)

## Related Articles

- [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story)
- [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk)
- [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know)
- [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers)
- [Coffee with Developers - Maria Apazoglou - Making AI understandable for all in production](https://www.wearedevelopers.com/magazine/475-coffee-with-developers-maria-apazoglou-making-ai-understandable-for-all-in-production)
- [Graph and AI Trends 2026: Why Is AI Running but Not Yet Delivering?](https://www.wearedevelopers.com/magazine/680-graph-and-ai-trends-2026-why-is-ai-running-but-not-yet-delivering)