Data Engineer

BravoTECH
Sunrise, United States of America
2 months ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English
Experience level
Senior

Job location

Remote
Sunrise, United States of America

Tech stack

Airflow
Amazon Web Services (AWS)
Amazon Web Services (AWS)
Databases
Data Transmissions
Information Engineering
Data Integrity
ETL
Data Security
Data Structures
Data Warehousing
Monitoring of Systems
Identity and Access Management
Python
PostgreSQL
Powershell
Query Optimization
Power BI
Salesforce
SQL Databases
Tableau
Scripting (Bash/Python/Go/Ruby)
Spark
Database Performance
Data Lake
Amazon Web Services (AWS)
Information Technology
Real Time Data
Kafka
Amazon Web Services (AWS)
Data Pipelines
Databricks

Job description

As a Senior Data Engineer, you will play a critical role in ensuring our client's data is ready to meet the needs of internal and external stakeholders. You will act as architect for data warehouse and data pipeline design, working with Product, Engineering, and Data Analytics teams to build a reliable and performant data platform., * Design and implement scalable data pipelines and platform components, leveraging tools such as Databricks, Airflow, and AWS Aurora.

  • Partner with Product and Engineering to build scalable systems that help unlock the value of data from a wide range of sources such as backend databases and marketing platforms.
  • Lead technical vision and architecture with a holistic point of view on both short-term and long-term horizons.
  • Define and implement data quality frameworks and monitoring systems to ensure ongoing trust in data assets. Enable real-time data presentation to facilitate management of a world-wide workforce.
  • Enable external use cases like customer-facing dashboards, self-serve analytics, and bulk data transfer.
  • Devise migration strategies to ensure data integrity and minimize downtime.
  • Define data quality frameworks to measure and monitor data quality across the enterprise.
  • Implement and maintain robust security measures to protect sensitive data. Ensure compliance with relevant data privacy regulations.
  • Collaborate with technical leadership and contribute to the evolution of data engineering best practices.
  • Serve as a subject matter expert on data engineering technologies, including Databricks, Airflow, and AWS Aurora. Provide guidance and support to development teams on data engineering best practices to ensure efficient data access and integration.
  • Collaborate with database engineers, data analysts, and application developers to understand data requirements and ensure data platform alignment.
  • Stay up to date with the latest data engineering technologies and trends.
  • Preferred: Candidates who demonstrate strong cross-functional communication skills and an interest in developing into leadership roles over time.

Requirements

Our Florida based healthcare client is seeking a highly skilled Senior Data Engineer to lead the next phase in the evolution of their data environment – from pipelines to platform. In this role, you will build the infrastructure that powers everything from customer insights to financial reporting and self-serve analytics. The ideal candidate will have a strong technical background and a vision for what is possible., * Bachelor's degree in Computer Science, Information Technology, or a related field.

  • Minimum of 5 years of experience as a Data Engineer.
  • Proven experience in data warehouse design, implementation, and maintenance using Databricks (Delta Lake, Autoloader, Unity Catalog, Jobs) and dbt.
  • Python + SQL (Spark) development experience.
  • Knowledge of data pipeline tools like Apache Airflow and Kafka (MSK).
  • Experience working with AWS cloud infrastructure, including S3, IAM/KMS, Aurora Postgres and RDS Postgres.
  • Postgres DBA depth: query tuning, autovacuum/fillfactor, EXPLAIN, Liquidbase familiarity.
  • Proficient with BI tools like Sisense, Power BI, or Tableau
  • Real-time ETL - Kafka streaming, (MSK/SQS)
  • Comfortable standardizing metrics and enabling trusted, consistent access to data
  • Excellent problem-solving and troubleshooting skills.
  • Strong communication and interpersonal skills.
  • Ability to work independently and as part of a team.
  • Preferred - Experience in a highly regulated industry (healthcare, banking, etc.)
  • Preferred - Experience with database performance tuning and optimization techniques.
  • Preferred - Knowledge of scripting languages (e.g., Python, PowerShell).
  • Preferred - Familiarity with Salesforce and its data structures.

Apply for this position