Data Engineer
Role details
Job location
Tech stack
Job description
Seeking a Data Engineer with strong experience in large-scale data solutions, cloud development, and analytics. The ideal candidate will have hands-on experience designing, developing, and supporting enterprise data pipelines and data lake environments in an agile, DevOps-driven environment., * Design, develop, and support scalable data pipelines and cloud-based data solutions
- Build and maintain data ingestion, processing, and transformation workflows
- Work within Azure cloud ecosystem to implement data lake and analytics solutions
- Collaborate with cross-functional teams in agile development environments
- Ensure data quality, governance, security, and performance optimization
- Support CI/CD pipelines and DevOps practices for data engineering workflows
Requirements
- Bachelor's degree in Computer Science, Computer Engineering, Information Systems, Engineering, or related technical field (or equivalent experience/training)
- 5-7 years of experience in software solution development in agile/DevOps environments
- 5-7 years of experience in data analytics using SQL
- 5-7 years of experience with cloud-based data engineering and data lake environments (preferably Azure)
- Experience designing, developing, and implementing large-scale applications or data engineering solutions, * Python
- Spark
- Unix/Linux
- SQL
Data Platforms
Experience with several of the following:
- Teradata
- Cassandra
- MongoDB
- Oracle
- SQL Server
- Azure Data Lake Storage (ADLS)
- Snowflake
- Azure Data Explorer
Cloud Technologies (Azure Preferred)
- Azure Data Factory
- Azure Databricks
- Azure Blob Storage
- Azure Data Lake
- Azure Functions
- Azure Event Hub
- Azure DevOps
- Power Apps
- Power BI
CI/CD & DevOps Tools
- GitHub
- Jenkins
- Azure DevOps
- Terraform
BI & Analytics Tools
- Power BI
- Tableau
- Cognos
- Alteryx
- Denodo
- Grafana
Data Engineering Concepts
- Data warehousing principles
- Data ingestion, transformation, and curation
- Data governance and data privacy concepts
Data Governance Tools (Preferred)
- Informatica Axon
- Informatica EDC
- BigID
Orchestration Tools
- Azure Data Factory
- Tivoli, * 5-7 years of experience building enterprise-scale data engineering solutions using agile/DevOps methodologies
- Strong experience with Azure-native data services (ADF, Databricks, ADLS, Event Hub, Azure Functions, ADX)
- Experience in airline or transportation industry environments (preferred but not required)
- Azure Development certification (preferred)
- Spark certification (preferred)
Benefits & conditions
Our benefits package includes
- Comprehensive medical benefits
- Competitive pay
- 401(k) retirement plan
- ...and much more!
About INSPYR Solutions Technology is our focus and quality is our commitment. As a national expert in delivering flexible technology and talent solutions, we strategically align industry and technical expertise with our clients'' business objectives and cultural needs. Our solutions are tailored to each client and include a wide variety of professional services, project, and talent solutions. By always striving for excellence and focusing on the human aspect of our business, we work seamlessly with our talent and clients to match the right solutions to the right opportunities. Learn more about us at inspyrsolutions.com.
INSPYR Solutions provides Equal Employment Opportunities (EEO) to all employees and applicants for employment without regard to race, color, religion, sex, national origin, age, disability, or genetics. In addition to federal law requirements, INSPYR Solutions complies with applicable state and local laws governing nondiscrimination in employment in every location in which the company has facilities