Data Engineer

Bright Sol
Alpharetta, GA, United States
about 2 months ago
Apply on www.dice.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Experienced
Experience required
3 years minimum
Working hours
Regular working hours
Job source

Tech stack

Artificial Intelligence Airflow Apache HTTP Server Microsoft Azure Continuous Integration Information Engineering Extract Transform Load (ETL) Data Migration Data Warehousing Dimensional Modeling Python (Programming Language) Standard Sql
+14 more
SQL Databases Azure Data Factory Snowflake Git Data Lakes Pyspark Luigi Star Schema Spark Streaming Data Management Azure Synapse Analytics Data Pipelines Jenkins Databricks

Job description

We are seeking a hands-on Data Engineer experienced in building, maintaining, troubleshooting, and optimizing modern cloud data pipelines., * Design and develop end-to-end data pipelines using Databricks & Snowflake

  • Build scalable ETL/ELT workflows using Python, PySpark & SQL
  • Develop Databricks notebooks, jobs, Delta Lake tables and workflows
  • Build Azure data solutions using ADF, ADLS & Synapse
  • Optimize Snowflake queries, clustering, storage, partitioning and materialized views
  • Implement data quality and governance processes
  • Develop streaming pipelines using Spark Streaming or similar technologies
  • Build and maintain CI/CD pipelines for data workflows
  • Troubleshoot production pipelines and resolve performance/data-quality issues
  • Collaborate with Data Scientists, Analysts, Engineers and Business Stakeholders
  • Support data migration initiatives in a fast-paced environment

️ CLIENT SCREENING - PLEASE READ

This client is extremely selective and closely reviews resumes.

Candidates should have genuine, hands-on experience with the technologies listed on their resume and must be able to explain their projects and technical contributions in detail during the interview.

DO NOT add or inflate technologies that the candidate cannot technically explain.

Candidates must confidently demonstrate experience with:

Databricks Snowflake Azure PySpark Python SQL ETL/ELT Data Pipelines

SUBMISSION DETAILS

Please provide:

Updated Resume LinkedIn Profile Current Location Visa Status Availability Confirmation of willingness to work onsite 5 days/week

Long-term opportunity with renewable SOW anticipated through the end of 2027.

Hiring #DataEngineer #DataEngineering #Databricks #Snowflake #Azure #PySpark #Python #SQL #AzureDataFactory #ADLS #Synapse #DeltaLake #ETL #ELT #DataPipelines #Airflow #DBT #Spark #CloudJobs #PlanoJobs #AlpharettaJobs #NewJerseyJobs #ContractJobs

Requirements

Experience: 3+ Years

MUST-HAVE TECHNOLOGIES

**Databricks Snowflake Azure Python PySpark SQL**, * 3+ years of hands-on Data Engineering experience
  • Strong Python, PySpark & SQL
  • Hands-on Databricks & Snowflake
  • Strong Azure Data Services experience
  • Azure Data Factory (ADF), ADLS & Azure Synapse
  • ETL/ELT pipeline development
  • Data Lake / Data Warehouse architecture
  • Databricks Notebooks, Jobs & Delta Lake
  • Data Modeling: Star Schema, Snowflake Schema & Dimensional Modeling
  • Orchestration: Airflow, dbt, Luigi or similar
  • Git & CI/CD
  • Jenkins or similar CI/CD tools
  • Data Quality, Governance, Security & Compliance

NICE TO HAVE

  • Palantir Foundry
  • Unity Catalog
  • Spark Streaming / Real-Time Data Pipelines
  • IBM watsonx.data or similar AI data platforms
  • Apache Iceberg / Lakehouse technologies
  • GenAI / RAG / LangChain
  • MCP (Model Context Protocol)

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.dice.com
Prepare application

Good distractions

Loading talks and stories from around this role…