> Markdown version of [/jobs/ext/1434033-sr-data-engineer](https://www.wearedevelopers.com/jobs/ext/1434033-sr-data-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Sr Data Engineer - **Company:** Intersources Inc. - **Location:** New York, NY, United States - **Experience:** Expert - **Contract:** Permanent contract - **Skills:** Clean Code Principles, Application Programming Interfaces (APIs), Agile Methodology, Artificial Intelligence, Amazon Web Services, Business Analytics Applications, Automation of Tests, Unit Testing, Big Data, Software Quality, Information Systems, Continuous Integration, Data Architecture, Information Engineering, Data Transformation, Data Warehousing, Relational Databases, Django Web Framework, Elasticsearch, Github, Design of User Interfaces, Python (Programming Language), PostgreSQL, Machine Learning, NoSQL, Software Architecture, Cloud Services, Logstash, Software Engineering, Data Ingestion, Large Language Models, Snowflake, Backend, AngularJS, Integration Tests, Kubernetes, Information Technology, Non-relational Database, Celery, Front End Software Development, Kibana, Restful APIs, Terraform, Elk Stack, Jenkins - **Published:** July 25, 2026 - **Apply:** https://www2.jobdiva.com/portal/?a=62jdnw10t7d77ytz0lbaey9qxonk3b05a9tqw96rb7z6hlfo7xj79l9g6mp6aj2o&compid=0/jobs/31857286#/jobs/31857286 ## About the Role * Professional experience: 5+ years in software engineering, with a full-stack background building data-intensive applications using Python, Kubernetes, relational and non-relational databases, and modern UI technologies. * Backend expertise: 3+ years working with Python and Django; building scalable, containerized services with robust APIs and comprehensive unit/integration tests. * Modern data engineering: Strong experience with relational SQL databases (e.g. PostgreSQL), data warehouses (e.g. Snowflake), Data Transformation tooling (e.g. dbt), and NoSQL databases. * Testing and QA: Solid understanding of unit testing, CI/CD automation, and quality assurance processes to ensure reliable, maintainable code. * Agile methodology: Working knowledge of Agile development practices and workflows. * Education: Bachelor's or Master's degree in Computer Science, Statistics, Informatics, Information Systems, or a related quantitative field. Preferred Skills & Experience: * Machine learning and AI: Hands-on experience with large language models (LLMs) and agentic frameworks/workflows. * Search and analytics: Familiarity with the ELK stack (Elasticsearch, Logstash, Kibana) for search and analytics solutions. * Cloud expertise: Experience with AWS cloud services; familiarity with SageMaker; and CI/CD tooling such as GitHub Actions or Jenkins. * Front-end expertise: Experience building user interfaces with Angular or a modern UI stack. * Financial domain knowledge: Broad understanding of equities, fixed income, derivatives, futures, FX, and other financial instruments. ## Description We are seeking a motivated engineer with strong full-stack data engineering skills to join our innovative, dynamic team. This role focuses on building reliable, scalable data products and user experiences that power AI/ML modeling, agentic workflows, and reporting. You will work end-to-end - from data ingestion and transformation through to UI - to deliver production-grade solutions in a collaborative, fast-paced environment. Our application stack runs entirely on AWS and includes Angular for the frontend; Python/Django with AWS-managed PostgreSQL (RDS/Aurora) for the API layer; Elasticsearch for search; SageMaker for machine learning; and Python/Celery for background processing. We also leverage Terraform for infrastructure as code, GitHub Actions for CI/CD, and Kubernetes (EKS) for container orchestration. We are investing heavily in our data architecture, leveraging Snowflake, data transformation tooling (e.g. dbt), and modern data ingestion frameworks., * Collaborative development: - partner with business stakeholders, data scientists, and engineering teammates to define and adopt modern data engineering practices. * Full-stack data engineering: - build across the entire stack, including data ingestion/acquisition and transformation, APIs, front-end components, and automated test suites. * Specification and design: - translate short- and long-term business requirements, architectural considerations, and competing timelines into clear, actionable specifications. * Code quality: - write clean, maintainable, efficient code that adheres to evolving standards and quality processes, including unit tests and isolated integration tests in containerized environments. * Continuous improvement: - contribute to agile practices and provide input on technical strategy, architectural decisions, and process improvements. ## Related Videos - [Leveraging Real time data in FSIs](https://www.wearedevelopers.com/videos/806-leveraging-real-time-data-in-fsis) - [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works) - [Celery on AWS ECS - the art of background tasks & continuous deployment](https://www.wearedevelopers.com/videos/561-celery-on-aws-ecs-the-art-of-background-tasks-continuous-deployment) - [Debug a Kubernetes Operator](https://www.wearedevelopers.com/videos/487-debug-a-kubernetes-operator) - [Add Location-based Searching to Site with ElasticSearch](https://www.wearedevelopers.com/videos/77-add-location-based-searching-to-site-with-elasticsearch) - [Walking into the era of Supply Chain Risks](https://www.wearedevelopers.com/videos/376-walking-into-the-era-of-supply-chain-risks) ## Related Articles - [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk) - [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers) - [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know) - [Coffee with Developers - Maria Apazoglou - Making AI understandable for all in production](https://www.wearedevelopers.com/magazine/475-coffee-with-developers-maria-apazoglou-making-ai-understandable-for-all-in-production) - [Why Upskilling And Reskilling is Important For Developers](https://www.wearedevelopers.com/magazine/428-why-upskilling-and-reskilling-is-important-for-developers) - [Is Software Engineering Over-Saturated?](https://www.wearedevelopers.com/magazine/418-is-software-engineering-over-saturated)