Full Stack Data Engineer
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Tech stack
+27 more
Job description
We’re seeking a highly skilled and experienced professional to play a pivotal role in the development and maintenance of our Enterprise Data Platform. In this role, you’ll be responsible for designing, building, and optimizing scalable data pipelines within our Google Cloud Platform (GCP) environment. This is a fantastic opportunity to leverage your full-stack expertise, collaborate with talented teams, and establish best practices for data engineering., * Collaborate with business and technology stakeholders to understand current and future data requirements.
- Design, build, and maintain reliable, efficient, and scalable data infrastructure for data collection, storage, transformation, and analysis.
- Plan, design, build, and maintain scalable data solutions including data pipelines, data models, and applications for efficient and reliable data workflow.
- Design, implement, and maintain existing and future data platforms like data warehouses, data lakes, data lakehouse, etc., for structured and unstructured data.
- Design and develop analytical tools, algorithms, and programs to support data engineering activities like writing scripts and automating tasks.
- Ensure optimum performance and identify improvement opportunities.
Requirements
Data Management, Cloud Computing, Best Practices, GCP (Good Clinical Practices), Scalable System Development, Computer Science, Data Analysis, Information Technology & Information Systems, Software Engineering, Java, * Bachelor’s degree in Computer Science, Information Technology, Information Systems, Data Analytics, or a related field (or equivalent combination of education and experience).
- 5-7 years of experience in Data Engineering or Software Engineering, with at least 2 years of hands-on experience building and deploying cloud-based data platforms (GCP preferred).
- Strong proficiency in SQL, Java, and Python, with practical experience in designing and deploying cloud-based data pipelines using GCP services like BigQuery, Dataflow, and DataProc.
- Solid understanding of Service-Oriented Architecture (SOA) and microservices, and their application within a cloud data platform.
- Experience with relational databases (e.g., PostgreSQL, MySQL), NoSQL databases, and columnar databases (e.g., BigQuery).
- Knowledge of data governance frameworks, data encryption, and data masking techniques in cloud environments.
- Familiarity with CI/CD pipelines, Infrastructure as Code (IaC) tools like Terraform and Tekton, and other automation frameworks.
- Excellent analytical and problem-solving skills, with the ability to troubleshoot complex data platform and microservices issues.
- Passion for data, innovation, and continuous learning.
- Applicants must be able to work directly for Artech on W2, * Master’s Degree
- Experience in monitoring and optimizing cost and compute resources for processes in GCP technologies (e.g., BigQuery, Dataflow, Cloud Run, DataProc).
- Prior work experience in the industry.
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Good distractions
Loading talks and stories from around this role…