Senior Data Engineer
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Tech stack
+22 more
Job description
We are seeking a Senior Data Engineer to join our Data Services team. The ideal candidate will be an individual contributor responsible for developing ETL workflows, API integrations, supporting business-as-usual (BAU) processes, and collaborating with cross-functional teams to ensure smooth data integration, quality, and governance. This role requires expertise in Azure Databricks, ADF, Pentaho, Globalscape FTP, API Development, SQL stored procedures, and complex queries. ETL & Data Integration:
- Design, develop, and optimize ETL pipelines using Azure Databricks, ADF, and Pentaho to support enterprise data workflows.
- Implement and maintain data movement, transformation, and integration across multiple systems.
- Ensure seamless data exchange between cloud, on-prem, and hybrid environments.
- Work with Globalscape FTP for secure file transfers and automation.
API Development and Integration:
- Develop, consume, and integrate RESTful and SOAP APIs to facilitate data .
- Work with API gateways and authentication methods such Oauth, JWT, certificate, and API keys.
- Implement and optimize API-based data extractions and real-time data integrations.
Data Quality & Governance:
- Implement data validation, cleansing, and enrichment techniques.
- Develop and execute data reconciliation processes to ensure accuracy and completeness.
- Adhere to data governance policies and security compliance standards.
BAU Support & Performance Optimization:
- Troubleshoot and resolve ETL failures, data load issues, and performance bottlenecks.
- Optimize SQL stored procedures and complex queries for better performance.
- Support ongoing enhancements and provide operational support for existing data pipelines.
Collaboration & Documentation:
- Work closely with Data Analysts, Business Analysts, and stakeholders to understand data needs.
- Document ETL processes, data mappings, and workflows for maintainability and knowledge sharing.
- Provide guidance and best practices to ensure scalability and efficiency of data solutions., Responsibilities: As a Senior Data Engineer on DAPI’s Tetris team, you will own the design and delivery of complex data engineering solutions that power NYBCe’s enterprise analyt…
- 2 months ago
Requirements
- 7+ years of experience in ETL development, data integration, and SQL scripting.
- Strong expertise in Azure Databricks, ADF (Azure Data Factory), and Pentaho.
- Experience handling secure file transfers using Globalscape FTP.
- Hands-on experience in developing and consuming APIs (REST/SOAP).
- Experience working with API security protocols (Oauth, JWT, API Keys, etc.,).
- Proficiency in SQL, stored procedures, performance tuning, and query optimization.
- Understanding of data modeling, data warehousing, and data governance best practices.
- Hands-on experience with cloud-based data platforms (Azure/AWS) is a plus.
- Strong problem-solving skills, troubleshooting abilities, and ability to work independently.
- Excellent communication skills and ability to work in a fast-paced environment.
About the company
Ampcus Inc. is a certified global provider of a broad range of Technology and Business consulting services. We are in search of a highly motivated candidate to join our talented Team., Ampcus Inc. is a certified global provider of a broad range of Technology and Business consulting services. We are in search of a highly motivated candidate to join our talented Te…, New York Blood Center
- Rye, NY
- $127,000 per year Founded in 1964, New York Blood Center (NYBC) has served the tri-state area for more than 60 years, delivering 500,000 lifesaving blood products annually to 150+ hospitals, EMS and…
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Good distractions
Talks and stories from around this role — technically off-topic, practically not.
Moments
Explore playlistsVideos
See allRelated articles
See all
Top Big Data Technologies That You Need to Know
Highest Paying Tech Companies for Developers
Data Engineer Salary UK
What Are The Top Skills Required For Azure Developers?