Big Data Engineer | Atlanta, GA (Hybrid)

Seeking a Data Engineer to support a modern cloud data platform built on a lakehouse architecture. This role combines hands-on engineering with business collaboration-translating r…

• 29 days ago

• Must have hands-on experience with Databricks
• Must have hands-on experience with high-velocity high-volume stream processing: Apache Kafka and Spark Streaming
• Experience with real-time data processing and streaming techniques using Spark structured streaming and Kafka
• Deep knowledge of troubleshooting and tuning Spark applications
• Must have hands-on experience with Python and/or Scala i.e. PySpark/Scala-Spark
• Experience with Traditional ETL tools and Data Modeling
• Strong knowledge of Messaging Platforms like Kafka, Amazon MSK & TIBCO EMS or IBM MQ Series
• Experience with Databricks UI, Managing Databricks Notebooks, Delta Lake with Python, Delta Lake with Spark SQL, Delta Live Tables, Unity Catalog
• Experience with data ingestion of different file formats across like JSON, XML, CSV
• Knowledge of Unix/Linux platform and shell scripting 9. Experience with Cloud platforms e.g. AWS, GCP, etc.

Experience with database solutions like Kudu/Impala, or Delta Lake or Snowflake or BigQuery Niranjan Kumar | Technical Recruiter, *Eligible applicants must be United States Citizens with the ability to obtain a government security clearance. About Infinitive Infinitive is a data and AI consultancy that ena…