Data Engineer

Retail Services WIS Corp
Plano, TX, United States
2 days ago
Apply on www.indeed.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
5 years minimum
Working hours
Regular working hours
Job source

Tech stack

Airflow Amazon Web Services Microsoft Azure Big Data C Sharp (Programming Language) Cloud Database Information Systems Data Validation Information Engineering Data Governance Data Integration Extract Transform Load (ETL)
+39 more
Data Security Data Systems DevOps Fault Tolerance Apache Hadoop Python (Programming Language) PostgreSQL Microsoft SQL Server SQL Azure MongoDB NoSQL Performance Tuning Query Optimization Power BI SQL Stored Procedures SQL Databases Data Streaming Tableau (Software) Transact-SQL Unstructured Data Scripting Google Cloud Real Time Systems Microsoft Power Automate Azure Data Factory System Availability Apache Spark Database Performance Git Information Technology Apache Flink Cassandra Apache Kafka Data Management Machine Learning Operations Azure Synapse Analytics Data Pipelines Serverless Computing Databricks

Job description

We are seeking a highly skilled Senior Data Engineer to join our team; In this role, you will design, develop, and maintain robust and scalable SQL Server databases in Azure. The ideal candidate will have deep expertise in T-SQL, Azure SQL Database, performance tuning, and data integration, with a strong understanding of cloud-based data architecture and DevOps practices. Additionally, you will need to design, build, and maintain scalable data pipelines and infrastructure to support mission-critical runtime applications, including data ingest, consumption, and ETL. You will collaborate with cross-functional teams to ensure data availability, reliability, and performance, driving insights that power critical business operations. Essential Responsibilities:

  • Expertise in T-SQL: Design, develop, and optimize complex T-SQL queries, stored procedures, views, and functions.
  • Data Pipeline Development: Design, develop, and optimize robust, scalable, and fault-tolerant data pipelines to process structured and unstructured data at scale.
  • Performance Optimization: Optimize data systems for performance, cost-efficiency, and scalability, ensuring low-latency access to data for analytics and applications.
  • Diagnostics: Troubleshoot database performance and availability issues.
  • Compliance: Ensure data security, integrity, and compliance with organizational and regulatory standards.
  • Collaboration: Partner with software engineers, project managers, and other stakeholders to understand data needs and deliver solutions that enable low-latency, high availability, eventually consistent consumption patterns.
  • Data Quality: Implement data validation, monitoring, and governance frameworks to ensure data accuracy, consistency, and compliance with privacy and security standards.
  • Tooling and Automation: Leverage modern tools and frameworks (e.g., Apache Spark, Kafka, Airflow, or equivalent) to automate data workflows and improve operational efficiency.
  • Mentorship: Provide technical guidance and mentorship to junior data engineers, fostering a culture of innovation and continuous improvement.

Requirements

  • Experience: 5+ years of experience in data engineering or a related field, with a proven track record of building large-scale data systems.
  • Bachelor’s in Computer Science, Information Systems, or related field.
  • Technical Skills:
  • Strong proficiency in T-SQL and query optimization.
  • Experience with Azure Data Factory, Logic Apps, and Azure Functions.
  • Familiarity with DevOps practices and tools (e.g., Azure DevOps, Git).
  • Expertise in SQL and experience with relational and NoSQL databases (e.g., MSSQL Server, PostgreSQL, MongoDB, Cassandra).
  • Strong experience with big data technologies (e.g., Hadoop, Spark, Flink) and cloud platforms (e.g., AWS, GCP, Azure).
  • Familiarity with data orchestration tools (e.g., Airflow, Dagster) and data modeling techniques.
  • Knowledge of data streaming technologies (e.g., Kafka, Azure Event Hubs) and real-time processing.
  • Problem-Solving: Strong analytical and problem-solving skills, with the ability to tackle complex data challenges and deliver efficient solutions.
  • Collaboration: Excellent communication and teamwork skills, with experience working in cross-functional environments.

Preferred Qualifications

  • Experience with machine learning pipelines or MLOps frameworks.
  • Microsoft Certified: Azure Data Engineer Associate or similar certification.
  • Experience with tableau, Power BI, Synapse Analytics, or Databricks.
  • Knowledge of Python or C# for data-related scripting.
  • Experience in Agile/Scrum environments.
  • Familiarity with data governance, compliance, and privacy regulations (e.g., SOC, NIST, GDPR, CCPA).
  • Contributions to open-source data projects or relevant certifications.

Benefits & conditions

Work is primarily sedentary: must be able to sit for extended periods of time and use a computer, keyboard, and mouse, frequently. Please note that this Job Description is not designed to cover or contain a comprehensive listing of activities, duties, or responsibilities that are required of the employee for this job. Duties, responsibilities, and activities may change at any time with or without notice.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.indeed.com
Prepare application

Good distractions

Loading talks and stories from around this role…