> Markdown version of [/jobs/ext/2591238-senior-data-engineer](https://www.wearedevelopers.com/jobs/ext/2591238-senior-data-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Senior Data Engineer - **Company:** Vericast Corp. - **Location:** San Antonio, TX, United States - **Experience:** Expert - **Salary:** $130,000.0 - $150,000.0 - **Contract:** Permanent contract - **Skills:** Agile Methodology, Artificial Intelligence, Airflow, Amazon Web Services, Amazon S3, Data Analysis, Apache HTTP Server, Microsoft Azure, Unix, Cloud Computing, Computer Programming, Information Engineering, Data Infrastructure, Extract Transform Load (ETL), Relational Databases, Linux, Distributed Systems, Apache Hadoop, Apache Hive, Python (Programming Language), Machine Learning, Object-Oriented Software Development, Operational Databases, DataOps, Data Streaming, Transaction Data, Workflow Management Systems, Data Logging, Data Processing, Apache Spark, Gitlab, Data Lakes, Pyspark, Kubernetes, Information Technology, Rancher, Apache Kafka, Data Management, Data Lakehouse, Data Delivery, Restful APIs, Data Pipelines - **Published:** August 24, 2026 - **Apply:** https://jobs.smartrecruiters.com/Vericast/744000145288289-senior-data-engineer- ## About the Role * Bachelor's degree in Computer Science, Information Technology, or a related field, with 5+ years of relevant experience; or * Master's degree in Computer Science, Information Technology, or a related field (preferred)., * 5+ years of experience in Data Engineering, ETL development, or Data Platform Engineering. * Experience working within a Financial Institution (FI), Banking, FinTech, MarTech, AdTech, Marketing Services, or Marketing Agency environment. * Experience supporting customer, campaign, audience, marketing performance, attribution, advertising, or transactional data at scale. * Strong experience with Python and PySpark for building production-grade data pipelines. * Experience designing, building, and supporting Data Lakehouse environments. * Experience working with Apache Airflow, Iceberg, Hive, S3, and Trino. * Experience with cloud platforms such as AWS, Azure, or GCP. * Experience with Agile software development methodologies. * Experience with GitLab and CI/CD processes. * Experience supporting AI and machine learning applications. * Understanding of machine learning models and the data requirements needed to support Data Science teams. Preferred * Experience building REST APIs. Preferred Knowledge, Skills & Abilities * Strong programming skills in object-oriented/functional scripting languages such as Python and PySpark for building data pipelines, with experience in testing, logging, and ensuring data observability. * Experience with distributed systems and parallel data processing using big data tools such as Spark, PySpark, Hadoop, Kafka, and Hive. * Proficiency with relational databases. * Strong knowledge of Linux/Unix-based systems. * Strong experience with Iceberg, Hive, S3, and Trino. * Experience building data pipelines with orchestration tools such as Apache Airflow. * Hands-on experience with Apache Ranger and Rancher/Kubernetes. * Excellent analytical, conceptual, and problem-solving skills. * Strong communication skills that promote cross-team collaboration. * Experience supporting data requirements for AI applications. (Preferred) * Understanding of machine learning models and algorithms, with the ability to interface with the Data Science team. (Preferred) * Experience building REST APIs. (Preferred) ## Description Vericast is seeking a motivated Senior Data Engineer to build big data pipelines, automate marketing campaigns, and support data requirements for our analytics, reporting, and AI applications. This role will expand our data infrastructure and pipeline architecture while optimizing data flow and collection into our Data Lake environment. The Senior Data Engineer will work closely with our analytics, reporting, and data science teams on data initiatives, ensuring that a consistent, optimal data delivery architecture is available throughout ongoing projects. The ideal candidate is self-directed and comfortable supporting the data needs of multiple teams, systems, and products. This role is a great fit for someone who enjoys working in an agile team environment and contributing to high-quality, data-driven marketing products in close collaboration with developers and business partners., * Develop scalable data pipelines and build new integrations to support continued growth in data volume and complexity. * Build a robust Data Lakehouse that supports Vericast's marketing solutions business and financial institution clients, including pre-sales, campaign execution, and campaign performance analysis and benchmarking. * Collaborate with AI, Analytics, and business teams to improve data models that feed AI and analytics tools, increasing data accessibility and fostering data-driven decision-making across the organization. * Implement processes and systems to monitor data quality and ensure the availability and accuracy of production data for key stakeholders and dependent business processes. * Perform data analysis to troubleshoot data-related issues and support their resolution. * Provide post-deployment support, responding quickly to resolve unexpected production issues. * Partner with business units and engineering teams to shape long-term data platform architecture strategy. ## Related Videos - [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works) - [WeAreDevelopers LIVE - Modern DevOps for IoT Devices and More](https://www.wearedevelopers.com/videos/1805-wearedevelopers-live-modern-devops-for-iot-devices-and-more) - [Docker network without Docker](https://www.wearedevelopers.com/videos/1418-docker-network-without-docker) - [WeAreDevelopers LIVE - Node and Package Security](https://www.wearedevelopers.com/videos/2138-wearedevelopers-live-node-and-package-security) - [Enabling automated 1-click customer deployments with built-in quality and security](https://www.wearedevelopers.com/videos/83-enabling-automated-1-click-customer-deployments-with-built-in-quality-and-security) - [Docker exec without Docker](https://www.wearedevelopers.com/videos/1094-docker-exec-without-docker) ## Related Articles - [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers) - [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know) - [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk) - [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story) - [How to Become an AI Engineer](https://www.wearedevelopers.com/magazine/331-how-to-become-an-ai-engineer) - [How We Built a Worry-Free System That Runs for 10+ Years – And What We’d Do Again](https://www.wearedevelopers.com/magazine/751-how-we-built-a-worry-free-system-that-runs-for-10-years-and-what-we-d-do-again)