Business Intelligence & Data Engineer

Versalytix, Inc.
Maryville, TN, United States
5 days ago
Apply on www.versalytix.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
1 year minimum
Compensation
$98,500.0 - $105,500.0
Working hours
Regular working hours

Tech stack

Code Review Continuous Integration Data Validation Information Engineering Data Governance Extract Transform Load (ETL) Data Warehousing Dimensional Modeling Python (Programming Language) Performance Tuning Query Optimization Tensorflow
+14 more
SQL Databases SQL Server Integration Services Transact-SQL Management of Software Versions Data Ingestion Azure Data Factory Apache Spark Git Pandas Microsoft Fabric Information Technology HuggingFace Software Version Control Data Pipelines

Job description

Our client is looking for a Senior Business Intelligence & Data Engineer to connect traditional BI engineering with modern cloud analytics. On the traditional side, that means T-SQL and ETL, with SSIS a plus. On the modern side, it means scalable data pipelines into Microsoft Fabric and transformations built in notebooks using Python and Pandas. The role focuses on: Data ingestion Data modeling Transformations Getting the semantic layer ready for analytics You won’t build production reports. You will need to understand reporting needs well enough to design data and semantic models that support analytics and self-service BI., + Design and implement ingestion pipelines that move data from source systems into Microsoft Fabric (Lakehouse/Warehouse). Sources include SQL databases, files, APIs, and SaaS applications.

  • Build and maintain pipelines using Azure Data Factory (ADF) and/or Fabric-native orchestration.
  • Build transformation logic in notebooks using Python, Pandas, and Spark where applicable.
  • Apply best practices in three areas: o Data quality checks and validation o Reproducibility: parameterization, modular notebooks, and version control o Performance optimization: partitioning, pushdown, and caching strategies Design and maintain enterprise data warehouse models. Prepare data for semantic models and analytics use. Work with report developers and analysts to make sure models match how the business actually uses BI. Work with analysts, application teams, and data owners to turn requirements into scalable pipelines and models. Take part in code reviews, documentation, and handoffs to operations. Help set standards for naming, versioning, environments, and deployment.

Requirements

Work Authorization: Must be authorized to work in the U.S. without current or future sponsorship, + 3+ years of professional experience in BI, data engineering, or data warehouse development in an enterprise environment

  • 2+ years of hands-on T-SQL, including: o Complex joins o window functions o CTEs

  • Query optimization and performance tuning
  • Building transformation logic in SQL
  • 2+ years designing and implementing ETL/ELT pipelines
  • 1+ years building pipelines with Azure Data Factory or a comparable orchestration tool
  • 3+ years applying modern data warehousing principles, including: o Layered architectures (raw, curated, consumption)

  • ELT patterns
  • Batch and incremental loading strategies
  • 3+ years of hands-on dimensional modeling, including: o Star and snowflake schemas o Fact and dimension table design o Surrogate keys and SCD Type 1/2

  • 1+ years developing transformations in notebooks
  • Working knowledge of how analysts and business users consume data, including: o Gathering requirements o Visual performance considerations o Data shaping

  • Strong verbal and written communication skills, and a collaborative approach
  • Ability to manage your own workload, meet tight deadlines, and work independently with minimal supervision
  • A bachelor’s degree in Computer Science, Engineering, or a related field is preferred, + Microsoft Fabric experience: Lakehouse, Warehouse, pipelines, notebooks, and shortcuts
  • Power BI semantic models and tabular modeling concepts
  • SSIS
  • Data governance, cataloging, and lineage practices
  • CI/CD for data assets: Git integration and environment promotion
  • TensorFlow, PyTorch, or Hugging Face

Work Environment

  • Professional office environment
  • Occasional physical activity, including bending, kneeling, squatting, standing, walking, reaching (including overhead), and fine motor tasks

About the company

Versalytix is conducting this search on behalf of our client, an established U.S. manufacturer. Our client is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, age, disability, or protected veteran status.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.versalytix.com
Prepare application

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

6:21 min

Investigating push inefficiencies with upstream Git experts

Jonathan Creamer · Coffee With Developers

2:03 min

Accelerating pandas dataframes using cudf module plugins

Ankit Patel Ankit Patel · World Congress 2024

1:39 min

Fundamentals of tensors and the TensorFlow library

Håkan Silfvernagel · LIVE

3:09 min

Balancing data science skillings alongside systems engineering rigor

Nico Schmidt · LIVE

56 sec

Favorite git commands and the importance of patch commits

Eileen Uchitelle Eileen Uchitelle +1 · Coffee With Developers

3:03 min

Career evolution in data engineering and AI platforms

Maria Apazoglou · Coffee With Developers

Videos

See all

Related articles

See all