Lead Software Engineer, Databricks & Cloud

U.S. Bank
Hopkins, MN, United States
3 days ago
Apply on www.techcareers.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
6 years minimum
Compensation
$133,365 - $156,900
Working hours
Regular working hours

Tech stack

Unity 3d Application Programming Interfaces (APIs) Artificial Intelligence Airflow Amazon Web Services Amazon S3 Apache HTTP Server Automation of Tests Microsoft Azure Cloud Computing Cloud Database Code Review
+26 more
Continuous Integration Data Architecture Information Engineering Extract Transform Load (ETL) Data Systems Apache Hive Identity and Access Management Python (Programming Language) Power BI Azure Data Lake SQL Databases Data Streaming Tableau (Software) Datadog Retrieval-Augmented Generation Snowflake Multi-Cloud Git Data Lakes Pyspark Collibra Apache Kafka Terraform Software Version Control Data Pipelines Databricks

Job description

Lead the design and delivery of scalable, governed data products on a Databricks Lakehouse across Azure and AWS . This hands-on technical leadership role will help advance Business Banking’s transition to Databricks by providing direction across engineering, product, architecture, and governance teams and delivering trusted data for analytics, reporting, and AI use cases., * Lead and guide Databricks data engineering across Bronze, Silver, and Gold layers, with particular focus on trusted, reusable Silver and Gold data products .

  • Translate business requirements into scalable data architecture, engineering designs, delivery standards, and technical acceptance criteria.
  • Remain hands-on in engineering and development, including coding, code review, and code management , while guiding the delivery of batch, CDC, streaming, API, and file-based data pipelines.
  • Review data models, solution designs, and critical code for quality, security, scalability, performance, and alignment with engineering standards.
  • Drive cross-cloud data integration and sharing across Azure, AWS, Databricks, and Snowflake.
  • Embed data quality, lineage, governance, PII and PCI controls, monitoring, and reliability into data solutions.
  • Establish engineering best practices for CI/CD, testing, source control, deployment, and observability.
  • Provide technical leadership through influence across distributed onshore, offshore, and GCC engineering teams, establishing clear standards and guiding delivery without direct people-management responsibility .
  • Partner with product, architecture, governance, platform, and business stakeholders to resolve technical dependencies, risks, and delivery challenges.

Requirements

  • Bachelor’s degree, or equivalent work experience
  • Six to eight years of relevant experience, * Strong hands-on experience with Python, PySpark, SQL , Spark SQL, and ETL/ELT development.
  • Hands-on expertise with Databricks, Delta Lake, Unity Catalog, medallion architecture , and Databricks Workflows/Lakeflow.
  • Experience building batch, CDC, streaming, API, and file-based pipelines, including Kafka or Azure Event Hubs.
  • Strong cloud data engineering experience with Azure and/or AWS , including experience with services such as ADLS Gen2, Data Factory, S3, IAM, and related technologies.
  • Knowledge of Snowflake, Delta Sharing, Delta UniForm, Apache Iceberg, and cross-cloud data sharing.
  • Experience with data modeling, Power BI/DAX, data quality, governance, lineage, and PII/PCI controls.
  • Strong knowledge of Git, CI/CD, automated testing, technical design, architecture reviews, and engineering best practices.
  • Demonstrated ability to provide technical direction, code review, and engineering guidance across distributed teams through influence rather than direct authority ., * Experience working across multi-cloud environments.
  • Experience with Terraform, Apache Airflow, Datadog, Collibra, Tableau, or Databricks Metric Views.
  • Experience supporting AI/RAG or advanced analytics data use cases.
  • Banking, financial services, or other regulated-industry experience.
  • Experience working with Business Banking or commercial banking data products.
  • Databricks, Snowflake, Azure, or AWS certifications.

Benefits & conditions

Our approach to benefits and total rewards considers our team members’ whole selves and what may be needed to thrive in and outside work. That’s why our benefits are designed to help you and your family boost your health, protect your financial security and give you peace of mind. Our benefits include the following:

  • Healthcare (medical, dental, vision)
  • Basic term and optional term life insurance
  • Short-term and long-term disability
  • Pregnancy disability and parental leave
  • 401(k) and employer-funded retirement plan
  • Paid vacation (from two to five weeks depending on salary grade and tenure)
  • Up to 11 paid holiday opportunities
  • Adoption assistance
  • Sick and Safe Leave accruals of one hour for every 30 worked, up to 80 hours per calendar year unless otherwise provided by law

Review our full benefits available by employment status here (https://careers.usbank.com/global/en/benefits/us) .

U.S. Bank is an equal opportunity employer. We consider all qualified applicants without regard to race, religion, color, sex, national origin, age, sexual orientation, gender identity, disability or veteran status, and other factors protected under applicable law.

E-Verify

U.S. Bank participates in the U.S. Department of Homeland Security E-Verify program in all facilities located in the United States and certain U.S. territories. The E-Verify program is an Internet-based employment eligibility verification system operated by the U.S. Citizenship and Immigration Services. Learn more about the E-Verify program (https://careers.usbank.com/verification-of-eligibility-for-employment) .

The salary range reflects figures based on the primary location, which is listed first. The actual range for the role may differ based on the location of the role. In addition to salary, U.S. Bank offers a comprehensive benefits package, including incentive and recognition programs, equity stock purchase 401(k) contribution and pension (all benefits are subject to eligibility requirements). Pay Range: $133,365.00 - $156,900.00

U.S. Bank will consider qualified applicants with arrest or conviction records for employment. U.S. Bank conducts background checks consistent with applicable local laws, including the Los Angeles County Fair Chance Ordinance and the California Fair Chance Act as well as the San Francisco Fair Chance Ordinance. U.S. Bank is subject to, and conducts background checks consistent with the requirements of Section 19 of the Federal Deposit Insurance Act (FDIA). In addition, certain positions may also be subject to the requirements of FINRA, NMLS registration, Reg Z, Reg G, OFAC, the NFA, the FCPA, the Bank Secrecy Act, the SAFE Act, and/or federal guidelines applicable to an agreement, such as those related to ethics, safety, or operational procedures.

Applicants must be able to comply with U.S. Bank policies and procedures including the Code of Ethics and Business Conduct and related workplace conduct and safety policies.

About the company

At U.S. Bank, we’re on a journey to do our best. Helping the customers and businesses we serve to make better and smarter financial decisions and enabling the communities we support to grow and succeed. We believe it takes all of us to bring our shared ambition to life, and each person is unique in their potential. A career with U.S. Bank gives you a wide, ever-growing range of opportunities to discover what makes you thrive at every stage of your career. Try new things, learn new skills and discover what you excel at-all from Day One.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.techcareers.com
Prepare application

Good distractions

Loading talks and stories from around this role…