> Markdown version of [/jobs/ext/560374-big-data-engineer-atlanta-ga-hybrid](https://www.wearedevelopers.com/jobs/ext/560374-big-data-engineer-atlanta-ga-hybrid). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Big Data Engineer | Atlanta, GA (Hybrid) - **Company:** Stellent IT LLC - **Location:** Atlanta, GA, United States - **Contract:** Permanent contract - **Skills:** Tibco Ems, Amazon Web Services, Big Data, BigQuery, Cloud Computing, Cloudera Impala, Extract Transform Load (ETL), Database Development, Apache Hive, IBM WebSphere MQ, JSON, Python (Programming Language), Enterprise Messaging Systems, Performance Tuning, Shell Script, Simple Data Format, Extensible Markup Language (XML), Data Ingestion, Snowflake, Apache Spark, Data Lakes, Pyspark, Apache Kafka, Spark Streaming, Stream Processing, Databricks - **Published:** June 5, 2026 - **Apply:** https://www.careerjet.com/jobad/us4e122770c3b20c7471f4aa24093723e2 ## About the Role * Must have hands-on experience with Databricks * Must have hands-on experience with high-velocity high-volume stream processing: Apache Kafka and Spark Streaming * Experience with real-time data processing and streaming techniques using Spark structured streaming and Kafka * Deep knowledge of troubleshooting and tuning Spark applications * Must have hands-on experience with Python and/or Scala i.e. PySpark/Scala-Spark * Experience with Traditional ETL tools and Data Modeling * Strong knowledge of Messaging Platforms like Kafka, Amazon MSK & TIBCO EMS or IBM MQ Series * Experience with Databricks UI, Managing Databricks Notebooks, Delta Lake with Python, Delta Lake with Spark SQL, Delta Live Tables, Unity Catalog * Experience with data ingestion of different file formats across like JSON, XML, CSV * Knowledge of Unix/Linux platform and shell scripting 9. Experience with Cloud platforms e.g. AWS, GCP, etc. Experience with database solutions like Kudu/Impala, or Delta Lake or Snowflake or BigQuery Niranjan Kumar | Technical Recruiter, *Eligible applicants must be United States Citizens with the ability to obtain a government security clearance. About Infinitive Infinitive is a data and AI consultancy that ena… ## Description Seeking a Data Engineer to support a modern cloud data platform built on a lakehouse architecture. This role combines hands-on engineering with business collaboration-translating r… + 29 days ago ## Related Videos - [PySpark - Combining Machine Learning & Big Data](https://www.wearedevelopers.com/videos/44-pyspark-combining-machine-learning-big-data) - [Alibaba Big Data and Machine Learning Technology](https://www.wearedevelopers.com/videos/37-alibaba-big-data-and-machine-learning-technology) - [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works) - [Tips and Tricks for Working with JSON](https://www.wearedevelopers.com/videos/1229-tips-and-tricks-for-working-with-json) - [Data Science in Retail](https://www.wearedevelopers.com/videos/586-data-science-in-retail) - [Empowering Retail Through Applied Machine Learning](https://www.wearedevelopers.com/videos/976-empowering-retail-through-applied-machine-learning) ## Related Articles - [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know) - [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers) - [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk) - [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story) - [Fully Remote Software Engineer Jobs](https://www.wearedevelopers.com/magazine/447-fully-remote-software-engineer-jobs) - [Coffee with Developers - Maria Apazoglou - Making AI understandable for all in production](https://www.wearedevelopers.com/magazine/475-coffee-with-developers-maria-apazoglou-making-ai-understandable-for-all-in-production)