Data Engineer (GCP)
Role details
Job location
Tech stack
Job description
As a key member of the Data Team at Equinix, we are seeking an experienced GCP Data Engineer who will lead end-to-end development of complex Data Engineering use cases and drive the evolution of Equinix's Data Lake platform. You will design and build enterprise-scale data infrastructure and analytics solutions on Google Cloud Platform while providing technical mentorship to the data engineering team. The ideal candidate combines deep technical expertise in cloud-native data technologies with proven leadership skills and a passion for building robust, scalable data platforms that drive strategic business insights., * Participate in design and implementation of enterprise-scale data pipelines and platform architecture for End-to-End data products.
- Develop fault-tolerant, petabyte-scale data processing systems using advanced GCP services
- Evaluate and recommend new technologies, tools, and architectural approaches
- Build complex ETL/ELT workflows using Cloud Dataflow, Composer, Dataform/dbt, BigQuery and custom solutions
- Implement sophisticated real-time streaming architectures with Cloud Pub/Sub, Kafka and Apache Beam
- Design and optimize data processing workflows for performance, cost, and reliability
- Develop advanced data transformation logic and custom processing functions
- Implement data architectures and microservices-based data platforms
- Design multi-environment deployment strategies and automated scaling solutions
- Establish monitoring, alerting, and observability frameworks across the data platform
- Lead code reviews and establish quality assurance processes
- Provide technical guidance on complex problem-solving and optimization techniques
- Facilitate knowledge sharing sessions and technical training programs
- Collaborate with hiring managers on technical interviews and team expansion
- Implement comprehensive data governance frameworks and compliance controls
- Design fine-grained access controls and data classification systems
- Establish automated data quality monitoring and lineage tracking
- Ensure GDPR, SOX, and other regulatory compliance across data workflows
- Implement privacy-preserving techniques and data anonymization strategies
- Translate complex business requirements into scalable technical solutions
- Coordinate cross-functional initiatives involving multiple engineering teams, Equinix is committed to ensuring that our employment process is open to all individuals, including those with a disability. If you are a qualified candidate and need assistance or an accommodation, please let us know by completing this form.
Requirements
Technical Expertise
- GCP Services: 5+ years hands-on experience with BigQuery (advanced SQL, scripting, ML integration), Cloud Dataflow, Cloud Composer, Cloud Storage, Pub/Sub, and Vertex AI
- Programming: Expert-level Python/Java programming, proficiency in Python/Scala for Spark development
- Advanced Technologies: Deep experience with Apache Beam, Airflow, Kubernetes, Docker, and distributed computing
- Infrastructure: Extensive experience with Terraform, CI/CD pipelines, and cloud infrastructure management
- Database Systems: Advanced knowledge of both relational and NoSQL databases, data modeling, and performance optimization
Professional Experience
- Bachelor's or master's degree in computer science, Engineering, or related field
- 5+ years of data engineering experience with 4+ years specifically on Google Cloud Platform
- Proven track record of delivering complex, enterprise-scale data solutions
- Experience with data governance, compliance, and security frameworks
- Excellent written and verbal communication skills with ability to present to executives
- Experience working with cross-functional projects and managing stakeholder relationships
- Proven ability to translate business requirements into technical solutions
- Google Cloud Professional Data Engineer certification
- Experience with MLOps, feature stores, and machine learning pipeline development
- Knowledge of data science workflows and statistical analysis
- Experience with BI tools (Looker, Tableau) and advanced analytics platforms
Benefits & conditions
Our pay ranges reflect the minimum and maximum target for new hire pay for the full-time position determined by role, level, and location.The pay range shown is based on our compensation structure in place at the time of posting and may be updated periodically based on business needs. Individual pay is based on additional factors including job-related skills, experience, and relevant education and/or training.
The targeted pay range listed reflects the base pay only and does not include bonus, equity, or benefits. Employees are eligible for bonus, and equity may be offered depending on the position.
Equinix Benefits
As an employee, you become important to Equinix's success. We ensure all your benefits are in line with our core values: competitive, inclusive, sustainable, connected and efficient. We keep them competitive within the current marketplace to ensure we're providing you with the best package possible. So, wherever you are in your career and life, you'll be able to enhance your experience and bring your whole self to work.
Employee Assistance Program: An Employee Assistance program is available to all employees. US Benefits: - Insurance: You may enroll in health, life, disability and voluntary plans that are designed for you and your eligible family members. - Retirement: You and Equinix may contribute to a retirement plan to help you plan for your financial future. - Paid Time Off (PTO) and Paid Holidays: You will receive an accrued amount of PTO each pay period along with various paid holidays for you to rest and recharge. Eligibility requirements apply to some benefits. Benefits are subject to change and may be subject to specific plan or program terms.
