Cloud Data Engineer
Role details
Job location
Tech stack
Job description
Join our Data Engineering team as a Senior Cloud Data Engineer, where you will lead the development and implementation of data pipelines for our cloud-based enterprise data warehouse. This role will serve as a senior technical contributor within the data organization and will work closely with the AI and Automation and Data Insights teams to develop practical solutions that enhance data accessibility, enable natural language querying, and accelerate analytics insights across the enterprise.
The primary extraction platform is Netsmart's myAvatar electronic health record system, which uses InterSystems IRIS databases via ODBC connectors. The data warehousing technology is Snowflake, and the AI-enabled data integration platform is Matillion. The warehouse design uses a medallion architecture approach and is guided by the FHIR (Fast Healthcare Interoperability Resources) standard. Reporting domains include financial, operational, clinical, quality, and administrative metrics.
This is a hands-on engineering role expected to use AI to accelerate the development of data pipelines and contribute to the success of downstream business intelligence and AI initiatives. The Senior Cloud Data Engineer works with both technical and non-technical staff and relies on experience, judgment, and creativity to achieve objectives. Specific projects will vary widely depending on organizational need.
Essential Job Functions
Lead the design and maintenance of ETL processes, the data warehouse, and data model.
Build scalable and efficient systems that accommodate business growth and reduce processing costs.
Collaborate closely with the AI and Automation team to design semantic data models that support reliable AI-driven query generation.
Determine and implement performance improvements for data architectures.
Develop audit mechanisms to measure data accuracy and reduce resources required for systems support.
Create features, functions, and data sets to enhance analysis or simplify report development.
Monitor, refine, and resolve system performance issues.
Develop and enforce database development standards.
Recommend best practices for reporting and analytics.
Develop technical documentation, including requirements, design decisions, system architecture, data models, and data dictionaries.
Evaluate Snowflake and Matillion platform capabilities for potential adoption.
Keep apprised of industry trends and learn new techniques and tools as appropriate.
Function in accordance with operational guidelines and professional ethics.
Participate in staff development activities.
Other duties as assigned.
Requirements
Strong understanding of modern data warehouse architecture and analytics data modeling practices.
Strong skills writing and optimizing complex SQL queries against diverse relational databases.
Ability to communicate complex technical topics clearly to both technical and non-technical stakeholders.
Self-directed problem solver capable of leading new technical initiatives.
Knowledge of semantic data modeling and data governance principles.
Ability to translate complex analytical questions into scalable technical solutions.
Strong analytical and systems-thinking skills.
Experience with Snowflake or a similar cloud-based data platform, required.
Experience and Education Qualifications
Bachelor's Degree or equivalent experience in Computer Science, Data Engineering, Data Science, Information Systems, or related field.
5+ years of experience with enterprise data warehousing and business intelligence solutions.
Demonstrated experience building ETL pipelines in cloud-based enterprise environments.
Experience with Netsmart myAvatar, healthcare analytics, and/or the InterSystems IRIS database platform preferred.
Experience with Matillion data integration platform preferred.