Data Engineer

We seek an experienced Applications Lead (Technical Lead) to own technical support leadership for Data Analytics solution-supporting a global users across multiple Azure-based production environments. This is not an operations manager role; it is a hands-on technical leadership role focused on complex incident resolution, data-intensive troubleshooting, and performance / scalability in large datasets and pipelines.

You will serve as the escalation support technical lead for the most challenging cases (e.g., large datasets, heavy transformations, performance bottlenecks, configuration issues across data platforms), guiding support analysts and partnering with engineering/product to drive root cause closure and durable fixes. The role requires deep strength in PySpark, T-SQL, data engineering, and analytics platform troubleshooting across Databricks, SQL Server / DWH, Azure data services.

• 8+ years of experience in application support / technical lead / data platform troubleshooting roles, with demonstrated ownership of complex incident/problem resolution in production-like environments. Hands-on Azure Data Engineering and Python experience.

• Databricks + PySpark familiarity, including:
• Building/navigating workspaces and notebooks
• PySpark read/write operations and basic transformation logic
• Strong T SQL / DWH background, including:
• SQL database design and development
• Stored procedures, table & scalar functions, performance tuning via execution plans and indexing
• Advanced querying (CTEs, temp tables, correlated subqueries; cursors where appropriate)
• Experience with large-scale data wrangling, including scenarios with very large row counts (e.g., 100M+), and ability to reason about data complexity and performance bottlenecks.
• Strong understanding of RDBMS concepts and (preferred) MSBI stack fundamentals.
• Hands-on ETL and reporting experience, including troubleshooting of pipelines and data flows end-to-end.
• Strong communication skills: ability to explain complex data/platform issues clearly to engineers, support teams, and stakeholders.

Preferred Experience

• Hands-on SQL Diagnostics & Performance Tuning: Writing and optimizing advanced T SQL to diagnose and resolve issues (SPs, scalar/table functions, CTEs/temp tables, correlated subqueries; use execution plans, indexing strategy, and query refactoring for performance).
• Azure Data Factory (ADF): building pipelines and troubleshooting orchestration patterns; ability to map concepts between SSIS and ADF.
• ADLS file-format expertise: Parquet/Delta vs CSV/Excel tradeoffs for volume, performance, and operational supportability.
• Power BI workspace concepts (nice to have), plus data management/data analysis tools like Alteryx (nice to have).
• Basic accounting concepts to better interpret audit/financial datasets.
• Advanced Excel (Pivot, formulas, lookups, VBA macros) as a nice to have.
• SAP/Oracle ERP technical profile:
• Understanding ERP architecture
• Support implementation/customization/performance tuning of extraction code
• Basic ABAP/UNIX familiarity as a nice to have

Orion Innovation is a premier, award-winning, global business and technology services firm. Orion delivers game-changing business transformation and product development rooted in digital strategy, experience design, and engineering, with a unique combination of agility, scale, and maturity. We work with a wide range of clients across many industries including financial services, professional services, telecommunications and media, consumer products, automotive, industrial automation, professional sports and entertainment, life sciences, ecommerce, and education.