Salesforce Developer
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Tech stack
+11 more
Job description
PySpark BigQuery Pipelines Operations Data Lakes Scalability Apache Kafka Apache Flink Apache Hadoop Data Pipelines Data Engineering Business Valuation Integration Testing Architectural Design Google Cloud Dataproc Google Cloud Composer Full Stack Development Technical Requirements Artificial Intelligence Business Transformation Google Cloud Platform (GCP) Extract Transform Load (ETL) Python (Programming Language), We are seeking a midlevel Data Engineer with hands-on expertise in Hadoop, PySpark, Python, and real-time streaming technologies such as Kafka. This role supports a large-scale migration of on-prem data and processing workloads into Google Cloud Platform (GCP). The candidate will be responsible for designing, developing, and deploying data pipelines across both Hadoop and GCP environments in a highly collaborative team setting.
The ideal individual is a hard-core developer who can independently convert requirements into scalable technical designs, perform integration and production deployments, and follow enterprise change-management and access-management procedures. The team has an established Hadoop platform and is actively
standing up a new GCP platform, making this a critical role for data movement, orchestration, and modernization.
Build and support Spark-based processing pipelines in Hadoop using PySpark and Python
Develop and maintain real-time streaming pipelines using Kafka
Design and implement data flows using Spark Streaming and Flink
Migrate data and workloads from on-prem Hadoop to GCP
Work extensively with BigQuery, Cloud Composer, Data Proc, and GCP Cloud Storage
Translate business and technical requirements into architecture, design, and deployment deliverables
Conduct integration testing, production deployments, and pipeline optimization
Work closely with internal teams, architects, and stakeholders to support platform enablement
Follow enterprise change-management and access-management processes, PySpark BigQuery Pipelines Operations Data Lakes Scalability Apache Kafka Apache Flink Apache Hadoop Data Pipelines Data Engineering Business Valuation Integration Testing Architectural Design Google Cloud Dataproc Google Cloud Composer Full Stack Development Technical Requirements Artificial Intelligence Business Transformation Google Cloud Platform (GCP) Extract Transform Load (ETL) Python (Programming Language) +0
Requirements
-
3+ years of experience in Data Engineering including hands on experience working with Hadoop and Google Cloud Data Solutions
-
Experience with GCP Data Services: Big Query, Cloud Storage, Data Proc, Cloud Composer. Experience migrating on prem to GCP
-
2+ years of real time processing with Kafka, Flink, and Spark Streaming
-
3+ Years of data lake experience with Python, Individual compensation offered for this position within this range will depend on many factors, including qualifications, skills, relevant experience, job knowledge, geographic location, internal equity, and other pertinent job-related factors.
About the company
We’re partners in transformation. We help clients activate ideas and solutions to take advantage of a new world of opportunity. We are a team of 80,000 strong, working with over 6,000 clients, including 80% of the Fortune 500, across North America, Europe and Asia. As an industry leader in Full-Stack Technology Services, Talent Services, and real-world application, we work with progressive leaders to drive change. That’s the power of true partnership. TEKsystems is an Allegis Group company., We’re a leading provider of business and technology services. We accelerate business transformation for our customers. Our expertise in strategy, design, execution and operations unlocks business value through a range of solutions. We’re a team of 80,000 strong, working with over 6,000 customers, including 80% of the Fortune 500 across North America, Europe and Asia, who partner with us for our scale, full-stack capabilities and speed. We’re strategic thinkers, hands-on collaborators, helping customers capitalize on change and master the momentum of technology. We’re building tomorrow by delivering business outcomes and making positive impacts in our global communities. TEKsystems and TEKsystems Global Services are Allegis Group companies. Learn more at TEKsystems.com.
The company is an equal opportunity employer and will consider all applications without regard to race, sex, age, color, religion, national origin, veteran status, disability, sexual orientation, gender identity, genetic information or any characteristic protected by law.
San Francisco Fair Chance Ordinance: Pursuant to the San Francisco Fair Chance Ordinance, for all positions located in the city and county of San Francisco, we will consider for employment qualified applicants with arrest and conviction records.
Massachusetts Lie Detector: It is unlawful in Massachusetts to require or administer a lie detector test as a condition of employment or continued employment. An employer who violates this law shall be subject to criminal penalties and civil liability.
Use of Artificial Intelligence (AI): We may use Artificial Intelligence (AI) to support parts of our hiring process, including sourcing, screening, and evaluating candidates. AI helps assess applications and qualifications, but final decisions are made by our hiring team. By applying, you acknowledge and agree that your application may be reviewed using AI tools. Related Jobs Jr-Mid Level GCP Data Engineer TEKsystems
Phoenix, AZ*Remote
On Prem PySpark BigQuery Pipelines Operations Data Lakes Scalability Apache Kafka Apache Flink Apache Hadoop Data Pipelines Data Engineering Business Valuation Integration Testing Architectural Design Google Cloud Dataproc Google Cloud Composer Full Stack Development Technical Requirements Artificial Intelligence Business Transformation Google Cloud Platform (GCP) Extract Transform Load (ETL) Python (Programming Language) +0
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Good distractions
Talks and stories from around this role — technically off-topic, practically not.
Moments
Explore playlistsVideos
See allRelated articles
See all
Making Data Warehouses Fast: A Developer’s Story
How Much FAANG Companies Actually Pay Software Engineers in 2025
Data Engineer Salary UK
Got AI ideas but no money? Here are 10 free ways to level up your AI skills with Google Cloud