Lead Data/AI Engineering

DUTIES: Design, develop, and maintain scalable and efficient data pipelines utilizing advanced technologies such as Python, PySpark, and Databricks. Integrate data from diverse sources while ensuring high standards of data quality, consistency, and reliability. Formulate and implement comprehensive data architecture strategies, encompass data modeling, schema design, and data storage solutions, as well as optimizing data processing workflows for enhanced performance, scalability, and cost-efficiency. Collaborate with data scientists, analysts, and stakeholders is essential to accurately understand data requirements and deliver tailored data solutions. Identify and resolve data-related issues, support data infrastructure, and maintain detailed documentation of all data pipelines, architecture, and processes. Drive the design and implementation of data models to enhance business decision-making by generating insights from both internal and external data assets. Define data requirements, mine and validate large-scale structured and unstructured datasets using cloud-based tools and supporting both standard and customized data analyses. Develop robust mechanisms for data ingestion, analysis, validation, normalization, and cleaning alongside upholding best practices in data engineering and contributing to advanced data analytics and visualization initiatives. Utilize programming languages (Python, PySpark, and Scala). Use data warehousing solutions including Snowflake. Utilize advanced SQL skills. Work with Databricks within Azure cloud environments. Employ big data technologies, including Apache Spark, Hadoop, and Kafka, and data science concepts and machine learning.

Do you have experience in Databricks?, REQUIREMENTS: Requires a Bachelor’s degree, or foreign equivalent degree in Electrical and Electronic Engineering, Computer Science, or Information Technology and five (5) years of progressive, post-baccalaureate experience in the job offered or five (5) years of progressive, post-baccalaureate experience in a related occupation utilizing programming languages (Python, PySpark, and Scala); using data warehousing solutions including Snowflake; utilizing advanced SQL skills; working with Databricks within Azure cloud environments; and employing big data technologies, including Apache Spark, Hadoop, and Kafka, and data science concepts and machine learning.

Pulled from the full job description

• Tuition reimbursement
• Paid parental leave
• Parental leave
• 401(k)
• Health insurance
• Paid time off
• Employee discount, Our Lead Data/AI Engineering roles earn between $158,200 - $237,400 yearly. Not to mention all the other amazing rewards that working at AT&T offers.

Joining our team comes with amazing perks and benefits:

• Medical/Dental/Vision coverage
• 401(k) plan
• Tuition reimbursement program
• Paid Time Off and Holidays (based on date of hire, at least 23 days of vacation each year and 9 company-designated holidays)
• Paid Parental Leave
• Paid Caregiver Leave
• Additional sick leave beyond what state and local law require may be available but is unprotected
• Adoption Reimbursement
• Disability Benefits (short term and long term)
• Life and Accidental Death Insurance
• Supplemental benefit programs: critical illness/accident hospital indemnity/group legal
• Employee Assistance Programs (EAP)
• Extensive employee wellness programs
• Employee discounts up to 50% off on eligible AT&T mobility plans and accessories, AT&T internet (and fiber where available) and AT&T phone

Weekly Hours: 40