Principal, Data Engineering
Role details
Job location
Tech stack
Job description
The Principal, Da Engineering job provides thought leadership in the execution of stregic plans reled to design, development and maintenance of robust da systems. As a recognized subject mter expert in the field, this job leads the development of efficient processing and availability of da for analysis and reporting., * DATA PIPELINES: Provides thought leadership on the design and development of da pipelines th facilite the movement of da from various sources to internal dabases.
- DATA INFRASTRUCTURE: Influences the construction and optimizion of da infrastructure, providing approprie da forms to ensure da readiness for analysis.
- DATA FORMATS: Examines and sees improvement opportunities for approprie da forms to optimize da usability and accessibility across the organizion.
- STAKEHOLDER MANAGEMENT: Cultives positive relionships and partners to understand da needs and encourage alignment with organizional objectives.
- DATA SYSTEMS: Develops and guides the implemention of da products and solutions using advanced engineering and cloud-based technologies, ensuring they are designed and built to be scalable, sustainable, and robust.
- SOLUTIONS DEVELOPMENT: Leads efforts to improve the development of technical products and solutions driving big da and cloud-based technologies, ensuring they are designed and built to be scalable, sustainable, and robust.
- DATA FRAMEWORKS: Drives development standards and brings forward prototypes to test new da framework concepts and architecture pterns supporting efficient da processing and analysis and promoting standard methodologies in da management.
- AUTOMATED REPORTING SYSTEMS: Builds automed reporting systems th provide timely insights and facilite da driven decision making.
- DATA MODELING: Provides thought leadership on da modeling and preparion of da in dabases for use in various analytics tools and to develop da pipelines to move and improve da assets.
Requirements
- Minimum requirement of 6 years of relevant work experience. Typically reflects 10 years or more of relevant experience.
Preferred Qualificions:
-
ARCHITECTURAL LEADERSHIP: Defines long-term technical direction, establishes best practices, and ensures solutions are scalable, maintainable, and aligned with enterprise stregy.
-
OPERATIONAL EXCELLENCE MINDSET: Champions reliability, observability, and performance, ensuring da systems meet high standards for availability and quality.
-
STRATEGIC DECISION MAKING: Evalues competing priorities such as speed, cost, risk, and flexibility to make sound technical and architectural decisions.
-
CLOUD DATA PLATFORMS: deep expertise implementing cloud-based da warehouses, da lakes, and open table forms in large-scale production environments. Has hands-on experience with technologies such as Snowflake, AWS, and open lake house ecosystems.
-
DATA INGESTION: Demonstred proficiency in da collection, ingestion tools (Kafka, AWS Glue), and storage forms (Iceberg, Parquet)
-
DATA STREAMING: Experience developing da pipelines with streaming architectures and tools (Kafka, Flink).
-
DATA TRANSFORMATION: Strong background with using Spark for da transformion, including streaming, performance tuning, and debugging with Spark UI.
-
DEVOPS: Extensive experience in DevOps practices, including code management, CI/CD, and deployment stregies.
This role is loced in our Atlanta, GA office. The business will not sponsor applicants for work visas for this position.