IT SOFTWARE ENGINEER
Allied Llc
Houston, TX, United States
3 days ago
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Apply on www.careerjet.com
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Contract type
Temporary to permanent
Employment type
Full-time (> 32 hours)
Compensation
$69,550.0 - $125,725.0
Working hours
Regular working hours
Job source
Tech stack
Agile Methodology
Artificial Intelligence
Airflow
Business Analytics Applications
Microsoft Azure
Continuous Integration
Data Architecture
Information Engineering
Data Governance
Dataspaces
Data Systems
Github
+35 more
Apache Hadoop
Python (Programming Language)
PostgreSQL
Meta-Data Management
Microsoft SQL Server
MySQL
Online Transaction Processing
Performance Tuning
PowerDesigner
Power BI
OpenLink Endur
SAP (Applications)
Software Deployment
Software Engineering
SQL Databases
Data Streaming
Workflow Management Systems
Qliksense
Load Balancing
Azure Data Factory
Concurrency
Apache Spark
Fastapi
Containerization
Kubernetes
Luigi
Apache Kafka
Spark Streaming
Data Management
Virtual Agents
Data Delivery
Api Gateway
Data Pipelines
Docker
Databricks
Job description
Allied Reliability is seeking a contract Software Engineer to function as a Data Tech Lead to provide end-to-end leadership across architecture, engineering, governance, and capability development. You will:
- Deliver sustainable and innovative solutions to unlock value from data.
- Lead the architecture, Design and implementation of on-premises/cloud-based application development and Data solutions.
- Engage cross-functional teams to support project stakeholders in delivering data scope and operational excellence.
- Drive governance, metadata management, Data Modeling, cost optimization, high-volume performance tuning and agility in delivery.
- Engage effectively with senior leadership, resolve conflicts proactively, and represent the data organization with confidence and clarity., Leadership & Strategy
- Drive the architecture, design, and delivery of Data ecosystems for futuristic data platform.
- Define data product roadmaps and drive development of data solution using approved tech stack and related technologies.
- Align data engineering initiatives with long-term business and technology strategies.
- Provide technical leadership to ensure adherence to best practices, standards, and quality expectations.
Technical Oversight
- Lead data modelling and architecture using tools such as SAP PowerDesigner and WizDesign.
- Develop and optimize intelligent, AI-augmented data pipelines across ADF, ADLS, Databricks, DLT, and Structured Streaming to enable high-performance data delivery.
- OLTP schema design, normalization, indexing strategy, Performance tuning for transactional systems
- Transaction management, concurrency, deadlocks
- PostgreSQL, MySQL, SQL Server expertise (depending on Shell standards)
- Optimize Databricks workloads with a strong focus on performance and cost efficiency.
- Implement robust security, governance, lineage, and metadata controls using Unity Catalog.
- Troubleshoot pipeline issues, ensure high data quality, and enforce SLA compliance.
Governance & Quality Assurance
- Establish data governance frameworks covering security, privacy, quality, and lifecycle management.
- Monitor pipeline performance and lead root cause analysis for data and process issues.
- Drive CI/CD and touchless change management frameworks to enable seamless deployments.
- Stakeholder Management * Collaborate closely with PMs, BAs, Data Scientists, Architects, and business stakeholders. * Translate complex technical concepts into business terms for executive audiences. * Resolve conflicts and ensure alignment across strategic priorities. * Stakeholder management & executive communication, Join the ECI Group’s Professional Technical Services Network as a contract IT Software Engineer. This is a Houston based contract role with an anticipated 4-month duration with an… + 20 days ago + Apply easily +
Requirements
Technical Expertise
- 12-17 years of experience in data engineering, data architecture, or analytics platforms.
-
Deep expertise in:
- Azure Data Engineering (ADF, ADLS, Databricks, , DLT), AZURE Function, SQL, REST/FAST API, LogicApps
- Databricks Delta Live Tables & Structured Streaming
- Unity Catalog governance and lineage
- Strong hands-on skills in SQL, Python, Spark/Scala.
- Strong experience in data modeling, data architecture, and metadata management.
- CI/CD for application delivery (Azure DevOps/GitHub Actions)
- Containerization (Docker), Kubernetes basics
- API gateway, reverse proxies, load balancing
- Solution Data Architecture, Data Modeling tools like SAP PowerDesigner, BiZ Design
AI & Future-Ready Skills
- Working knowledge of AI/ML, GenAI, Agentic AI, and applying AI for data engineering automation.
- Ability to envision and build future-ready, scalable data ecosystems.
Soft Skills / Leadership Competencies
- Proven ability to lead mid-sized to large technical teams.
- Strong decision-making capabilities backed by data.
- Exceptional communication and executive presentation skills.
- Conflict management and stakeholder alignment experience.
- High accountability, ownership, and ability to drive independent outcomes.
- Adaptability and continuous learning mindset.
Nice to Have
- Experience with Kafka, Hadoop, Spark Streaming.
- Experience with workflow tools like Airflow, Azkaban, Luigi.
- Knowledge of PowerBI/QlikSense visualizations.
- Certifications in Azure Data Engineer, Databricks, AI/ML, or Data Science.
- Experience with GitHub/Azure DevOps, CI/CD, Agile/Kanban methodologies.
- Understanding of Freight Domain like Voyage Management, Chartering, Freight Pricing, Demurrage, Laytime, Port calls, Vessel scheduling
- Integration with RightAngle, Endur, Veson IMOS or internal Shell Freight systems
- Knowledge of T&S business processes
LI-TS1
Benefits & conditions
- $69,550-125,725 per year
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Apply on www.careerjet.com
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Good distractions
Talks and stories from around this role — technically off-topic, practically not.
Moments
Explore playlistsVideos
See allRelated articles
See all
EM
Eli McGarvie
over 3 years ago
BR
Benjamin Ruschin
Navigating the AI Shift
about 1 year ago
AJ
Austin Joy
What Are The Top Skills Required For Azure Developers?
over 4 years ago
CH
Chris Heilmann
Coffee with Developers - Maria Apazoglou - Making AI understandable for all in production
almost 2 years ago
EM
Eli McGarvie
Data Engineer Salary UK
over 3 years ago
LM
Luis Minvielle
Is Software Engineering Over-Saturated?
over 2 years ago