DATA SCIENTIST

South Carolina Public Service Authority (Inc)
Moncks Corner, SC, United States
19 days ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience required
1 year minimum
Compensation
$84,180.0 - $130,770.0
Working hours
Regular working hours
Job source

Tech stack

Application Programming Interfaces (APIs) Airflow Amazon Web Services Data Analysis Microsoft Azure Cloud Computing Cloud Database Continuous Integration Information Engineering Data Governance Extract Transform Load (ETL) Data Warehousing
+23 more
Supervisory Control and Data Acquisition (SCADA) Identity and Access Management JSON Job Scheduling Python (Programming Language) Networking Basics Performance Tuning Reliability Engineering Cloud Services SQL Databases Unstructured Data Parquet Informatica Powercenter Information Technology Low Latency Avro Bicep Apache Kafka Machine Learning Operations Software Coding Terraform Data Pipelines Databricks

Job description

Leads complex, enterprise-scale data engineering initiatives, architect cloud-native warehousing solutions, and mentor junior staff. You will design end-to-end ETL/ELT and analytics platforms using Databricks, Informatica, Python, SQL, and cloud services; set and enforce engineering standards; and engage stakeholders to translate business requirements into robust, secure, and performant data products that power analytics, reporting, and ML workflows.

This position is responsible for architecting and delivering cloud-native data platforms and pipelines that provide reliable, governed, and scalable data to the enterprise. Data Engineer III leads migrations to modern cloud warehouses, defines and enforces best practices (ETL design, coding standards, security), and builds modular, reusable components for analytics/reporting/ML. The role optimizes throughput, latency, and reliability, establishes SLAs and observability, and mentors engineers to uplift team capability.

Operates with broad autonomy, collaborating with executive and technical stakeholders to translate requirements into engineering specifications, cost-aware architectures, and operational runbooks. Ensures data governance (lineage, catalog, privacy), compliance, and resilience, while driving continuous improvement across performance tuning, incident response, and reliability engineering.

Essential Job Tasks:

  • Architects and develops enterprise-scale cloud data pipelines and warehousing solutions.
  • Leads migration initiatives from legacy platforms to cloud-native data warehouses.
  • Defines and enforces ETL/ELT design standards, coding practices, and security controls.
  • Builds modular, reusable data components for analytics, reporting, and ML feature pipelines.
  • Optimizes pipeline performance (throughput, latency, reliability) and establish SLAs/monitoring.
  • Provides technical leadership and mentor junior engineers; document frameworks and patterns.
  • Engages stakeholders; translate business requirements into engineering specs and roadmaps.
  • Governs data quality, lineage, and cataloging; ensure compliance with privacy/security policies., + Languages and platforms: Proficient in Python and SQL; Databricks (notebooks/jobs) and Informatica (ETL/ELT).
  • Cloud platforms: Hands on with Azure/AWS/GCP; familiarity with storage, compute, IAM, networking basics.
  • Data warehousing: Modeling (dimensional/star), partitioning, Delta/Parquet, medallion architecture; performance tuning.
  • Orchestration and reliability: Job scheduling, retries, alerting; CI/CD basics for data pipelines.
  • Data governance and quality: Validations, profiling, data contracts, lineage/catalog documentation; adherence to privacy/security policies. Collaboration and delivery: Translate stakeholder requirements; produce clear documentation and reproducible code artifacts; manage SLAs.
  • Preferred experience in the following: *

  • Orchestration: Airflow/Prefect, event-driven and batch scheduling; SCD patterns, CDC/streaming (Kafka/EventHub).
  • Platform components: Delta Live Tables, Feature Stores, Databricks SQL/Unity governance; Terraform/Bicep for infra-as-code.
  • Integration: APIs, semi-structured/unstructured data (JSON/Avro), file ingestion at scale; federated/virtualized query layers.
  • Domain: Utility/energy datasets (AMI, SCADA), compliance/governance in regulated environments.

Requirements

  • Bachelor’s Degree in Computer Science, Engineering, or related discipline + 2 years experience or Master’s Degree in Computer Science, Engineering, or related discipline + 1 year experience in data engineering (ETL/ELT, cloud warehousing, analytics) with advanced expertise in Databricks, Informatica, Python, SQL, and cloud data platforms.
  • Must have strong background in cloud data architecture, governance, performance optimization, and technical leadership/communication.
  • Must have experience in the following, * Bachelor’s Degree in Computer Science, Engineering, or related discipline + 5 years experience or master’s degree in computer science, Engineering, or related discipline + 3 years experience in data engineering (ETL/ELT, cloud warehousing, analytics) with advanced expertise in Databricks, Informatica, Python, SQL, and cloud data platforms.
  • Must have strong background in cloud data architecture, governance, performance optimization, and technical leadership/communication.
  • Must have experience in the following

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.indeed.com

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

3:09 min

Balancing data science skillings alongside systems engineering rigor

Nico Schmidt · LIVE

2:56 min

Provisioning a secure container infrastructure with Bicep

Matthias Falkenberg +1 · WWC 2022

3:02 min

Audience Q&A on data formats and engine tradeoffs

Matthias Niehoff Matthias Niehoff · WWC Europe 2026

3:47 min

Exploring JSON, CBOR, and JOSE for data serialization

Aaron Russell · LIVE

4:09 min

Selecting infrastructure tools and determining proper abstraction layers

Alayshia Knighten Alayshia Knighten · WWC 2024

1:52 min

Customizing block storage tiers and formats

Ricardo Sueiras Sueiras · LIVE

Videos

See all

Related articles

See all