Data Integration / Application Engineer

Motion Recruitment Partners LLC.
South San Francisco, CA, United States
1 day ago
Apply on www.dice.com
Prepare application

Role details

Contract type
Contract
Employment type
Full-time (> 32 hours)
Experience level
Experienced
Experience required
3 years minimum
Working hours
Regular working hours
Job source

Tech stack

Sql Data Warehouse Application Programming Interfaces (APIs) Artificial Intelligence Airflow Amazon Web Services User Authentication Information Systems Continuous Integration Data as a Services Data Validation Data Cleansing Information Engineering
+27 more
Data Integration Extract Transform Load (ETL) Data Transformation Database Applications Github R (Programming Language) Python (Programming Language) Octopus Deploy Cloud Services Software Deployment SQL Databases Data Streaming Systems Integration AI Infrastructure Data Logging Delivery Pipeline Snowflake Gitlab Git Pandas Pytest Information Technology Restful APIs Software Version Control Data Pipelines GXP Docker

Job description

Starting in January, worker must be in office 2.5 days/week, 10 days/month Conversion to FTE possible, depending on performance The Opportunity As a Data Integration / Application Engineer, you are a hands-on builder within BSO’s data and platform engineering pod, reporting to the Business Digital, Data & AI Infrastructure Lead. You will work closely with the Senior Snowflake Engineer / Technical Lead to maintain and enhance Octopus and other approved data products, developing integrations, automated pipelines and application-facing data services. You turn agreed business needs into reliable working solutions, test with users and help ensure that the underlying data remains accurate, secure and maintainable., * Data pipelines and integrations: Build and maintain scheduled pipelines that ingest, clean, reconcile and combine data from approved enterprise systems for Octopus and other BSO use cases.

  • Snowflake development: Write and maintain SQL transformations, data models, queries and views in Snowflake, working with the Senior Engineer on performance, access controls and maintainability.
  • Application enablement: Develop APIs, reusable data services and integrations that support internal dashboards, analytical applications and operational workflows.
  • Workflow automation: Build dependable Python jobs and automations for recurring data preparation, quality checks, exports and system-to-system updates.
  • Data quality and traceability: Implement validation, reconciliation, error handling and logging to keep business-critical data accurate, explainable and fit for use.
  • Quality and documentation: Deliver tested, version-controlled code; document interfaces, data mappings and operational procedures; contribute validation evidence for regulated use cases where required.
  • Testing and collaboration: Work with business users and Product Owners to clarify requirements, demonstrate working functionality, perform user testing and incorporate feedback.
  • Run and improve: Monitor existing pipelines and applications, resolve incidents and defects, and update integrations as upstream systems or business needs change.

Requirements

You are a practical, collaborative engineer who enjoys connecting systems and turning complex data into dependable business tools. You work iteratively, test your changes and write code that others can support.

  • Education: Bachelor’s degree in Computer Science, Engineering, Data Science, Information Systems or a related field, or equivalent practical experience.
  • Experience: At least 3 years building or supporting data pipelines, enterprise integrations, analytical applications or internal business tools in production.
  • Python: Strong Python for data processing, API integration, scheduled jobs and testing (for example pandas, requests and pytest).
  • SQL and Snowflake: Good SQL, including joins, transformations and data quality checks, with hands-on experience using Snowflake or another cloud data warehouse.
  • APIs and integration: Experience integrating enterprise systems through REST APIs, authentication, structured payloads and error handling.
  • Data engineering: Practical experience with ELT/ETL workflows, orchestration, reconciliation and monitoring of automated data flows.
  • Ways of working: Git/GitLab and version control; writes tested, documented code and works iteratively with senior engineers and non-technical stakeholders., * Experience developing dashboards or data-driven applications using R Shiny, Shiny for Python or similar tools.
  • Snowpark, dbt, Airflow or comparable data transformation and orchestration technologies.
  • Building reliable connectors and curated datasets for AI-enabled business workflows.
  • Experience with business intelligence, reporting and data preparation tools.
  • Deploying applications and scheduled jobs with CI/CD, Docker and cloud services such as AWS.
  • Experience in pharmaceutical R&D, resource planning or another regulated environment (GxP).
  • A GitHub profile or portfolio showing relevant work is an advantage.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.dice.com
Prepare application

Good distractions

Loading talks and stories from around this role…