Big Data Lead

PwC
Denver, United States of America
4 days ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English
Experience level
Senior
Compensation
$ 202K

Job location

Remote
Denver, United States of America

Tech stack

Adobe Experience Manager
Artificial Intelligence
Data analysis
Big Data
Computer Security
ETL
Data Warehousing
Database Development
Generative AI
PySpark
Information Technology
Data Pipelines
Databricks

Job description

Be an Early Applicant Remote Hiring Remotely in United States Mid level Remote Hiring Remotely in United States Mid level Lead the development of data pipelines and transformations in Azure Databricks, converting Scala programs to PySpark while leveraging various Azure technologies. The summary above was generated by AI, Design and implement scalable data pipelines using Databricks, develop ETL processes, optimize workflows, ensure data security, and collaborate with stakeholders. Top Skills: DatabricksIbm SterlingAzurePysparkPythonSpark SqlTalendTeradata Hexaware Technologies

Big Data Lead

7 Hours Ago Remote United States Mid level Mid level Information Technology * Consulting The Big Data Lead will manage database development, ETL/ELT processes, and data warehousing, optimizing performance and ensuring data pipelines work reliably. Top Skills: AWSAws GlueAws S3AzureAzure BlobAzure Data FactoryAzure DevopsGitJenkinsOracleSnowflakeSQLTalendTeamcity PwC, Artificial Intelligence * Professional Services * Business Intelligence * Consulting * Cybersecurity * Generative AI As a Digital Marketing Technologist Senior Associate, you will drive digital strategies, manage marketing campaigns, and engage stakeholders to enhance brand visibility through data-driven insights and analytics. Top Skills: Adobe Experience Manager

What you need to know about the Colorado Tech Scene

With a business-friendly climate and research universities like CU Boulder and Colorado State, Colorado has made a name for itself as a startup ecosystem. The state boasts a skilled workforce and high quality of life thanks to its affordable housing, vibrant cultural scene and unparalleled opportunities for outdoor recreation. Colorado is also home to the National Renewable Energy Laboratory, helping cement its status as a hub for renewable energy innovation.

Key Facts About Colorado Tech

  • Number of Tech Workers: 260,000; 8.5% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Lockheed Martin, Century Link, Comcast, BAE Systems, Level 3
  • Key Industries: Software, artificial intelligence, aerospace, e-commerce, fintech, healthtech
  • Funding Landscape: $4.9 billion in VC funding in 2024 (Pitchbook)
  • Notable Investors: Access Venture Partners, Ridgeline Ventures, Techstars, Blackhorn Ventures
  • Research Centers and Universities: Colorado School of Mines, University of Colorado Boulder, University of Denver, Colorado State University, Mesa Laboratory, Space Science Institute, National Center for Atmospheric Research, National Renewable Energy Laboratory, Gottlieb Institute

Requirements

  • Azure databricks- Build Data Pipelines using ADB-Leveraging Python and Spark
  • Build Data Transformation in ADB
  • Convert Scala Pgms to Py Spark Pgms
  • Understand the SCALA program in DataBricks
  • ADF
  • Secondary Skills:
  • Azure data lake gen 2
  • Synapse analytics (dedicated SQL pool)
  • Exp in delta Lake
  • Pyspark

Nice to Have : Tidal Scheduler , Exp in Healthcare Domain

About the company

PwC provides services to 420 out of 500 Fortune 500 companies. The firm was formed in 1998 by a merger between Coopers & Lybrand and Price Waterhouse.

Apply for this position