> Markdown version of [/jobs/ext/2544725-sr-engineer-data-engineering](https://www.wearedevelopers.com/jobs/ext/2544725-sr-engineer-data-engineering). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Sr Engineer, Data Engineering

- **Company:** Pilot Company
- **Location:** Knoxville, TN, United States
- **Experience:** Expert
- **Contract:** Permanent contract
- **Skills:** Amazon Web Services, Microsoft Azure, Big Data, Data Architecture, Information Engineering, Data Warehousing, Relational Databases, Python (Programming Language), PostgreSQL, Microsoft SQL Server, Oracle (Applications), Queueing Systems, Cloud Services, Google Cloud, Snowflake, Apache Spark, Data Lakes, Information Technology, Data Analytics, Star Schema, Spark Streaming, Data Management, Databricks
- **Published:** August 21, 2026
- **Apply:** https://www.techcareers.com/job.asp?id=3361195767&tx=JR4337FFP&pt=1&aff=0B19D771-A501-4A5E-8338-2A822B784D54&utm_source=Job%20Feed&utm_medium=textkernel&utm_campaign=DE&utm_term=0B19D771-A501-4A5E-8338-2A822B784D54

## About the Role

* Bachelor's degree in computer science, engineering, information technology, or related field, required.
 * Minimum eight (8) years of technology operations experience required.
 * Experience in the commodities and energy space preferred.
 * Strong SQL knowledge and skills required
 * Strong knowledge of Relational Databases like Oracle, Postgres or SQL Server required
 * Experience with Apache Spark or Spark-streaming, Message Queue technologies and Python required
 * Strong knowledge of enterprise data warehouse (EDW) data models with a focus on Star Schema data modeling techniques required
 * Experience with unified data platforms such as Databricks or Snowflake preferred
 * Strong knowledge of Cloud Data platforms such as Amazon Web Services (AWS), Azure or Google Cloud preferred
 * Excellent analytical skills and the ability to identify solutions to complex data problems
 * Ability to provide excellent customer service
 * Excellent written and verbal communication skills
 * Willingness to learn and embrace new technologies
 * Ability to mentor and motivate a diverse team; ensure team and individual accountability and performance standards are met
 * Ability to prioritize, multitask and manage multiple projects successfully in a fast-paced and dynamic environment
 * Strong organizational skills with attention to detail
 * Ability to communicate and interact effectively with different levels of the organization to negotiate, problem solve, complete projects and influence decision making
 * Self-motivated with ability to work both independently and within teams in order to establish and meet deadlines, goals, and objectives, * Travel required less than 10%
 * General office work requiring sitting or standing for long periods of time
 * Able to lift up to 30 lbs.
 * Able to work evenings, weekends and odd hours as needed

## Description

The purpose of this job is to provide technical expertise for research, development and modification of data engineering processes and workflows in support of big data infrastructure for Pilot Travel Centers in the retail and energy space.

 1. Research, develop, document, and modify Data Engineering processes and jobs per data architecture and modeling requirements; collaborate with Data Analytics team members such as Data Strategists and Data Scientists
 2. Collaborate with business stakeholders to understand data needs including data velocity, veracity, and access patterns
 3. Provide technical expertise to implement Data and Analytics specifications
 4. Serve on cross-functional project teams and provide perspective for the Data Analytics team on executing key deliverables
 5. Troubleshoot complex, escalated issues including connection, failed jobs, application errors, server alerts and space thresholds within predefined service level agreements (SLAs)
 6. Proactively maintain and tune all code according to internally documented Data Engineering standards and best practices
 7. Review and ensure appropriate documentation for all new development and modifications of the Data Lake processes and jobs
 8. Perform code and process reviews and oversee testing for solutions developed, and ensure integrity and security of institutional data
 9. Educate business stakeholders on the usage and benefits of the
 10. Data Lake/Lakehouse and related technologies
 11. Mentor and guide less experienced team members and provide feedback on project work
 12. Model behaviors that support the company's common purpose; ensure guests and team members are supported at the highest level
 13. Ensure all activities are in compliance with rules, regulations, policies, and procedures
 14. Complete other duties as assigned


## Related Videos

- [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works)
- [Alibaba Big Data and Machine Learning Technology](https://www.wearedevelopers.com/videos/37-alibaba-big-data-and-machine-learning-technology)
- [How Cisco embraced a DevOps culture within its network engineering team](https://www.wearedevelopers.com/videos/99-how-cisco-embraced-a-devops-culture-within-its-network-engineering-team)
- [Cutting LLM Costs Without Cutting Quality: How to Beat Proprietary LLMs with Fine-Tuned Open Source](https://www.wearedevelopers.com/videos/100151-cutting-llm-costs-without-cutting-quality-how-to-beat-proprietary-llms-with-fine-tuned-open-source)
- [PySpark - Combining Machine Learning & Big Data](https://www.wearedevelopers.com/videos/44-pyspark-combining-machine-learning-big-data)
- [Remote Driving on Plant Grounds with State-of-the-Art Cloud Technologies](https://www.wearedevelopers.com/videos/251-remote-driving-on-plant-grounds-with-state-of-the-art-cloud-technologies)

## Related Articles

- [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers)
- [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk)
- [Fully Remote Software Engineer Jobs](https://www.wearedevelopers.com/magazine/447-fully-remote-software-engineer-jobs)
- [Top-Paying Tech Jobs (with Salaries)](https://www.wearedevelopers.com/magazine/372-top-paying-tech-jobs-with-salaries)
- [The 12 Best Jobs for Software Engineers](https://www.wearedevelopers.com/magazine/401-the-12-best-jobs-for-software-engineers)
- [How Much Does a Software Engineer Make? Realistic Software Engineering Salaries](https://www.wearedevelopers.com/magazine/425-how-much-does-a-software-engineer-make-realistic-software-engineering-salaries)