Data Engineer V

Insight Global
Oakland, United States of America
1 month ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English
Experience level
Senior

Job location

Oakland, United States of America

Tech stack

JavaScript
Agile Methodologies
Big Data
Business Software
Databases
Data Integrity
ETL
Data Structures
Data Systems
Data Visualization
Relational Databases
Database Queries
Python
Power BI
Salesforce
SAP Applications
Software Engineering
Tableau
TypeScript
GIT
PySpark
Information Technology
Software Version Control
Data Pipelines

Job description

  • Work closely with Subject Matter Experts (SMEs) to design and develop the ontology (data model) and data pipelines.

  • Design, implement, and maintain robust data pipelines and ETL processes.

  • Develop and optimize cloud-based data storage and processing solutions.

  • Collaborate with data analysts and data scientists to understand data requirements and deliver high-quality data solutions.

  • Ensure data integrity and security across all data workflows and storage solutions.

  • Monitor and troubleshoot data pipelines, addressing any issues promptly to ensure the smooth flow of data.

  • End to End data pipeline development - responsible for using Python and Pyspark to perform ETL and derive new datasets necessary for business applications.

We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.

Requirements

achelor's Degree in Computer Science, Engineering, or related field or related experience.

  • 5+ years of experience as a data engineer.

  • Hands-on experience with building data pipelines

  • Strong SQL skills and experience working with large datasets and complex data structures.

  • Proficient in Python, and Pyspark

  • Experience in Typescript (preferred) or Javascript

  • Excellent problem-solving and analytical skills with a strong attention to detail. * Experience with Palantir Foundry application development and data visualization tools

  • Knowledge with commercial visualization tools such as Tableau or Power BI.

  • Experience in Typescript (preferred) or Javascript

  • Databases - familiarity with common relational database models and proprietary instantiations, such as SAP, Salesforce etc.

  • Git - knowledge of version control / collaboration workflows and best practices

  • Agile - familiarity with agile and iterative working methodology and rapid user feedback gathering concepts

  • UX design - knowledge of best practices and applications

Apply for this position