> Markdown version of [/jobs/ext/2702495-data-engineer](https://www.wearedevelopers.com/jobs/ext/2702495-data-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Data Engineer - **Company:** Talascend LLC - **Location:** Chicago, IL, United States - **Experience:** Expert - **Salary:** $104,000.0 - $108,160.0 - **Contract:** Permanent contract - **Skills:** Amazon Web Services, Microsoft Azure, Cloud Computing, Data Integrity, Extract Transform Load (ETL), Apache HBase, Apache Hive, Information Sciences, JSON, Python (Programming Language), Microsoft SQL Server, SQL Azure, MongoDB, NoSQL, Azure Data Lake, Simple Data Format, Data Streaming, Parquet, Apache Spark, Data Lakes, Pyspark, Semi-structured Data, Information Technology, Cosmos DB, Spark Streaming, Stream Processing, Data Pipelines, Databricks - **Published:** September 4, 2026 - **Apply:** https://www.talascend.com/portal/jobseekers/jobs/136614/application ## About the Role * Minimum of 5 years of experience as a data developer using Python, PySpark, Spark SQL, and SQL Server, with a strong foundation in ETL concepts. * Bachelor's degree in Information Science, Computer Science, Mathematics, Statistics, or a related quantitative discipline. * Experience with Azure Cloud Platform, Databricks, and Azure storage solutions. * Effective written and verbal communication skills, including technical documentation. * Strong analytical and organizational skills., * Experience working with unstructured, semi-structured data, and data lake environments; familiarity with data streaming and event-driven data pipelines. * Hands-on experience with real-time or near real-time data processing. * Knowledge of JSON, Parquet, and other file formats. * Experience with NoSQL databases such as Hbase, MongoDB, Cosmos DB. * Cloud experience on Azure or AWS platforms. * Knowledge of Python with Spark, Spark Streaming, Azure SQL Server, Cosmos DB/MongoDB, Azure Event Hubs, Azure Data Lake Storage, and Azure Search. * Reliable, self-motivated team player capable of managing multiple projects in a fast-paced environment. ## Description This role involves designing and developing data solutions that are strategic for the business, utilizing the latest cloud data technologies such as Azure Databricks, Python, PySpark, SparkSQL, Azure functions, Delta Lake, and Azure DevOps CI/CD. The Data Engineer will work in a fast-paced environment supporting the enterprise data needs., * Design, architect, and develop solutions leveraging cloud big data technology to ingest, process, and analyze large, disparate data sets to meet business requirements. * Create data management and persistence solutions for application use cases via relational and non-relational databases, enhancing data processing capabilities. * Develop proofs of concept to influence platform architecture, product management, and software engineering teams, and facilitate migration to modern technology platforms. * Design data lake solutions for structured and unstructured data, providing technical guidance for migration and platform modernization. * Contribute to CI/CD processes, adhere to development best practices, and foster discipline within the data engineering team. * Build data pipelines, perform data cleansing, normalization, and transfer, and optimize ETL workflows using Azure Databricks and PySpark. * Conduct testing phases, including unit, system integration, regression, and user acceptance testing. * Translate business requirements into detailed technical solutions, and document and communicate data processes clearly. * Implement data security measures, including encryption, access controls, and compliance with data regulations, ensuring data integrity and confidentiality. * Troubleshoot data-related issues and assist in resolution processes. * Build agent-driven workflows for data loading and transformation, leveraging MCP framework and agent orchestration. ## Related Videos - [PySpark - Combining Machine Learning & Big Data](https://www.wearedevelopers.com/videos/44-pyspark-combining-machine-learning-big-data) - [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works) - [Leveraging Real time data in FSIs](https://www.wearedevelopers.com/videos/806-leveraging-real-time-data-in-fsis) - [Tips and Tricks for Working with JSON](https://www.wearedevelopers.com/videos/1229-tips-and-tricks-for-working-with-json) - [Data Science in Retail](https://www.wearedevelopers.com/videos/586-data-science-in-retail) - [Empowering Retail Through Applied Machine Learning](https://www.wearedevelopers.com/videos/976-empowering-retail-through-applied-machine-learning) ## Related Articles - [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story) - [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk) - [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know) - [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers) - [What Are The Top Skills Required For Azure Developers?](https://www.wearedevelopers.com/magazine/77-what-are-the-top-skills-required-for-azure-developers) - [Top-Paying Tech Jobs (with Salaries)](https://www.wearedevelopers.com/magazine/372-top-paying-tech-jobs-with-salaries)