Apache Airflow Data Engineer
Intersources Inc.
Santa Clara, United States of America
4 days ago
Role details
Contract type
Permanent contract Employment type
Full-time (> 32 hours) Working hours
Regular working hours Languages
English Experience level
IntermediateJob location
Remote
Santa Clara, United States of America
Tech stack
Agile Methodologies
Airflow
Databases
ETL
Data Retrieval
Data Warehousing
Software Debugging
Hadoop
Hadoop Distributed File System
Hive
Python
Pentaho Data Integration
Power BI
SQL Databases
Informatica Powercenter
Information Technology
QlikView
Tools for Reporting
Data Pipelines
Job description
- Perform and oversee data loading operations.
- Optimize data for extraction and reporting use.
- Manage complicated databases by performing suitable database management functions.
- Design and implement ETL jobs.
- Build, maintain, monitor, and orchestrate workflows or data pipelines.
- Ensure the high performance of data retrieval processes.
Requirements
- Bachelor's/master's degree in computer science or IT (or equivalent experience).
- 3+ years of industry experience as an Apache Airflow developer (rare exceptions for highly skilled candidates).
- Proficiency in Apache Airflow development.
- Expertise in Python and its frameworks.
- Strong understanding of data warehouse concepts and ETL tools (like Informatica, Pentaho, Apache Airflow).
- Experience working in SQL environment and with reporting tools (like Power BI and Qlik).
- Fluency in English to collaborate with engineering managers.
Preferred skills:
- Familiarity with Apache Hadoop, HDFS, Hive, etc.
- Excellent troubleshooting and debugging skills.
- Ability to work independently as well as with multi-disciplinary teams.
- Working knowledge of agile processes and methods.
About the company
InterSources Inc, a Certified Diverse Supplier, was founded in 2007 and offers innovative solutions to help clients with Digital Transformations across various domains and industries. Our history spans over 16 years and today we are an Award-Winning Global Software Consultancy solving complex problems with technology. We recognize that our employees and our clients are our strengths as the diverse talents and opportunities they bring to the table enable us to grow as a global platform and they are causally linked with our success. We provide strategic and technical advice, and we have expertise in areas covering Artificial Intelligence, Cloud Migration, Custom Software Development, Data Analytics Infrastructure & Cloud Solutions, Cyber Security Services, etc. We make reasonable accommodations for clients and employees and we do not discriminate based on any protected attribute including race, religion, color, national origin, gender sexual orientation, gender identity, age, or marital
status. We also are a Google Cloud partner company. We align strategy with execution and provide secure service solutions by developing and using the latest technologies that thrive our resources to deliver industry-leading capabilities to our clients and customers, making it convenient for our clients to do business with InterSources Inc. Our teams also drive growth by refining technology-driven client experiences that put the users first, providing an unparalleled experience. This results in strengthening the core technologies of clients, enabling them to scale with flexibility, create seamless digital experiences and build lifelong relationships.