Data Engineer
Magnit, Inc.
San Francisco, CA, United States
6 days ago
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Apply on arc.dev
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Contract type
Temporary contract
Employment type
Full-time (> 32 hours)
Experience level
Experienced
Experience required
4 years minimum
Working hours
Regular working hours
Job source
Tech stack
Application Programming Interfaces (APIs)
Artificial Intelligence
Data Analysis
Big Data
BigQuery
Cloud Computing
Cloud Database
Extract Transform Load (ETL)
Data Warehousing
Python (Programming Language)
Machine Learning
Power BI
+20 more
Tensorflow
Search Technologies
Tableau (Software)
Freeform SQL
Sql Optimization
Pytorch
Retrieval-Augmented Generation
Large Language Models
Snowflake
Generative AI
Agentic-AI
Scikit Learn
Information Technology
Claude
Virtual Agents
Google Gemini
GPT
Data Pipelines
Api Management
Amazon Redshift
Job description
- Design, develop, and maintain scalable ETL/data pipelines using Python and cloud-based technologies.
- Write, optimize, and troubleshoot complex SQL queries against large-scale datasets.
- Build and maintain interactive dashboards and reporting solutions using Tableau or similar BI tools.
- Perform exploratory data analysis and deliver actionable business insights.
- Develop and evaluate machine learning models for predictive analytics, clustering, and classification use cases.
- Collaborate with product, engineering, and business teams to define analytical requirements and solutions.
- Contribute to AI and GenAI initiatives, including AI agents, RAG architectures, vector search implementations, and API integrations.
- Support development, testing, and optimization of AI-driven applications and intelligent automation solutions.
Requirements
- Bachelorβs degree in Computer Science, Data Science, Artificial Intelligence, Machine Learning, or a related field.
- 5+ years of hands-on experience developing data pipelines and ETL workflows using Python.
- 5+ years of experience writing and optimizing SQL queries for large-scale datasets.
- Experience with modern cloud data warehouse technologies such as Snowflake, BigQuery, or Amazon Redshift.
- 5+ years of experience building dashboards and visualizations using Tableau, Power BI, or similar tools.
- 4+ years of experience developing machine learning models using frameworks such as Python, Scikit-learn, TensorFlow, or PyTorch.
- Strong understanding of data modeling, analytics, and cloud-based data architectures., * Masterβs degree in Computer Science, Data Science, Artificial Intelligence, Machine Learning, or a related field.
- Experience building GenAI or LLM-powered applications using technologies such as GPT, Claude, Gemini, or similar models.
- Hands-on experience with:
- Retrieval-Augmented Generation (RAG)
- Vector databases and semantic search
- AI agents and agent frameworks
- MCPs, APIs, and AI integrations
- Experience working in analytics, experimentation, or data product environments.
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Apply on arc.dev
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Good distractions
Loading talks and stories from around this roleβ¦