Principal Data Engineer
Creative Testing Solutions
Addison, TX, United States
18 days ago
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Apply on www.indeed.com
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
10 years minimum
Working hours
Regular working hours
Job source
Tech stack
Query Performance
Business Analytics Applications
Microsoft Azure
Big Data
Business Process Modeling
Cloud Engineering
Computer Networks
Databases
Computer Engineering
Data Deduplication
Information Engineering
Data Governance
+20 more
Data Infrastructure
Data Integrity
Extract Transform Load (ETL)
Data Transformation
Data Structures
Data Systems
Data Warehousing
Query Languages
Database Theory
DevOps
Identity and Access Management
Software Engineering
SQL Databases
Data Processing
Data Lakes
Data Analytics
Data Management
Cts+
Data Pipelines
Web Api
Job description
- Conceptualizes and implements foundational data models, Data Lake, ETL pipelines and curated layer servicing multiple reporting platforms.
- Writes and optimizes SQL queries for high performance and cost-effectiveness in large-scale data environments.
- Develops and manages data engineering architecture, and designs and implements Lakehouse and analytics solutions.
- Develops and coordinates cloud architecture across diverse areas including application development, identity and access management, network and data management, and security.
- Implements data management best practices including cleansing, deduplication, validation, and governance to ensure data integrity and quality.
- Designs, develops, and maintains robust scalable ETL/ELT data pipelines across multiple data sources and destinations.
- Collaborates with data analysts, data scientists, and software engineers to understand data needs and translates them into technical solutions.
- Optimizes data workflows for performance, scalability, and reliability.
- Builds and maintains data models and warehouse schemas in support of analytics and business intelligence initiatives.
- Optimizes query performance and database operations
- Ensures data quality, integrity, and compliance across all systems.
- Participates in architectural discussions and help drive best practices in data engineering.
- Collaborates with fellow data & analytics colleagues to foster a culture of teamwork and innovation.
- Mentors junior data engineers and contributes to the development of team standards and practices.
- Monitors data pipelines and resolves production issues in a timely manner.
- Partners closely with DevOps and platform teams to manage infrastructure and deployment of data tools.
- Performs all assigned duties in compliance with internal SOPs and external regulations. Brings compliance issues to the attention of management.
- Assures quality customer service to all customers.
- Maintains good attendance and punctuality per the absence policy.
- Performs all other duties, at the discretion of management, as assigned.
Requirements
- Education: Bachelor’s degree in Computer Engineering or related field of study, or equivalent technical experience.
- Experience: A minimum of ten (10) years of data engineering related experience; To include:
- Experience designing and implementing Data Warehouse Architectures, preferably in a lead or architect capacity.
- Experience with ETL/ELT pipelines, to-and-from various datastores (incl. operating systems, network share protocols, web APIs, and databases), as well as for data processing automation.
- Advanced experience with database concepts; solid understanding of query languages (e.g., SQL), data transformation techniques, data modeling, warehousing concepts, and best practices.
PREFERRED QUALIFICATIONS
- Knowledge of Azure cloud platform, Fabric data platform, ADF and DevOps is highly preferred
- Professional database certification
SKILLS & ABILITIES
- Strong business acumen, critical thinking, and ability to work cross functionally through collaboration with engineering and business partners.
- Ability to read and understand various data structures.
- Ability to work independently and as part of a team.
- Strong analytical, technical, and troubleshooting skills.
- Familiarity with data governance, privacy, and compliance standards.
- Must possess the skills and abilities to successfully perform all assigned duties and responsibilities.
- Must be able to maintain confidentiality.
- Ability to work in a team environment and participate as an active team member.
- Effective oral and written communication skills.
- Able to organize, prioritize, and execute a variable workload and multiple priorities., * Office work environment
- Travel: < 10%
- 5+ hours per shift: Sitting, finger dexterity, reaching waist to shoulder
- Up to 3 hours per shift: Standing, walking, bending, squatting, kneeling, handling, driving, reaching above shoulders, reaching waist to shoulder, reaching knee to waist, reaching floor to knee, grasping items, lift/carry/move items up to 40 pounds, push/pull items up to 10 pounds
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Apply on www.indeed.com
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Good distractions
Talks and stories from around this role — technically off-topic, practically not.
Moments
Explore playlistsVideos
See allRelated articles
See all
EM
Eli McGarvie
over 3 years ago
EM
Eli McGarvie
Highest Paying Tech Companies for Developers
over 3 years ago
BB
Benedikt Bischof
Making Data Warehouses Fast: A Developer’s Story
about 4 years ago
LM
Luis Minvielle
The Most Popular IT Jobs on the Market
over 2 years ago
LM
Luis Minvielle
Top-Paying Tech Jobs (with Salaries)
over 2 years ago
EM
Eli McGarvie
Data Analyst Salary in the UK
about 3 years ago