Sr. Data Engineer

SFE PARTNERS LLC
McLean, VA, United States
20 days ago
Apply on www.careerjet.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
5 years minimum
Working hours
Regular working hours

Tech stack

Airflow Data Analysis Profiling Information Engineering Data Mapping Data Profiling Python (Programming Language) Standard Sql SQL Databases Software Vulnerability Management Snowflake Apache Spark
+6 more
Build Management Data Lakes AWS Glue Api Design Data Pipelines Databricks

Job description

One-day interview loop consisting of: * Python Coding Assessment

  • Candidates must write code during the interview.
  • Approximately 1.5 hours of total coding assessments.
  • SQL Assessment

  • Must be able to write and explain SQL solutions.
  • System Design / Architecture Discussion

  • Data engineering architecture and design-focused questions.

Suppliers are encouraged to conduct their own technical screening prior to submission, as the hiring team prefers candidates who have already been vetted. Additional Notes

  • Work is primarily batch-processing focused.
  • Databricks will be used heavily during discovery and proof-of-concept phases before production implementation.

Requirements

Must-Have:

  • Python
  • Spark
  • SQL
  • Airflow
  • AWS Glue
  • Databricks

Preferred/Nice to Have:

  • Delta Lake
  • Snowflake
  • API experience

Strong Differentiators:

  • Data profiling and analysis
  • Data mapping
  • Production support experience
  • Vulnerability remediation
  • Experience supporting and maintaining pipelines in production environments

Candidate Profile

  • Ideal experience level: 5-10 years, with 5-7 years being a strong target range.
  • Candidates should demonstrate the ability to:

  • Design and build data pipelines
  • Support and troubleshoot production workloads
  • Perform data analysis, profiling, and mapping
  • Own operational support responsibilities in addition to development work

About the company

Disclaimer: We respect your online privacy. If you would like to be removed from our mailing list please reply with “Remove” in the subject and we will comply immediately. We apologize for any inconvenience caused. Please let us know if you have more than one domain. The material in this e-mail is intended only for the use of the individual to whom it is addressed and may contain information that is confidential, privileged, and exempt from disclosure under applicable law. If you are not the intended recipient, be advised that the unauthorized use, disclosure, copying, distribution, or the taking of any action in reliance on this information is strictly prohibited. We are an equal opportunity employer with a diverse workforce. Note : Any resume submitted by Fusionplusinc is presented with the understanding that the candidate is being considered for your direct end-client (end-client is the company where the work will be performed). If there is any other company involved between the end-client and your company, please do not submit this resume without our written approval. If you submit the resume to another third party, Fusionplusinc reserves the right to work with the third party directly.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.careerjet.com
Prepare application

Good distractions

Loading talks and stories from around this role…