Data Engineer Snowflake and Databricks -New York, NY -Hybrid

FinTrust Connect
New York, NY, United States
16 days ago
Apply on www.careerbuilder.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
5 years minimum
Compensation
$208,000
Working hours
Regular working hours

Tech stack

Unity 3d Airflow Automation of Tests Cyber Security Information Engineering Data Security Event-Driven Programming Python (Programming Language) Performance Tuning Role-Based Access Control Standard Sql SQL Databases
+13 more
Usage Analysis Scripting Azure Data Factory Snowflake Caching Git Data Lakes Pyspark AWS Glue Star Schema Apache Kafka Data Pipelines Databricks

Job description

Join our Talent Community for New York. Local postings emphasize production grade ELT on Snowflake and Databricks with strong Python and SQL and Airflow and dbt plus secure data sharing and cost governance. Demand is deep across banks and fintechs with senior ranges at the top of the market.

As a Data Engineer you will build reliable pipelines and modular models on Snowflake and Databricks, optimize cost and performance, and deliver trusted data for risk and finance and product analytics., * Design and deliver ELT pipelines with reproducible code and tests

  • Model data sets for analytics and BI and ML using medallion style layers
  • Implement data quality checks and SLAs with alerts and lineage
  • Tune warehouses and clusters and storage formats for cost and speed
  • Harden security roles and policies and secrets and PII handling

Outcomes we track:

  • Pipeline success rate 99.5% with data freshness SLAs met 95%+
  • Cost per query reduced 20% in 90 days through tuning
  • Data quality defects per release < 2 with automatic rollback

Requirements

Snowflake Schema, Python Programming/Scripting Language, Information/Data Security (InfoSec), SQL (Structured Query Language), Risk, Performance Tuning/Optimization, Financial Analysis, Cost Control, Financial Services, Warehousing, * 5 to 8 years in data engineering within financial services or high scale platforms

  • Hands on Snowflake warehouses and roles and RBAC and tasks and streams
  • Hands on Databricks PySpark and Delta Lake and Unity Catalog and jobs
  • Strong SQL and Python and performance tuning and partitioning and caching
  • Orchestration Airflow or dbt or Azure Data Factory or AWS Glue
  • CI and CD with Git and pull requests and automated tests
  • Nice to have Kafka or Kinesis and event driven patterns

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.careerbuilder.com
Prepare application

Good distractions

Loading talks and stories from around this role…