Data Engineer

Plan A Technologies
United States
15 days ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Experienced
Experience required
3 years minimum
Working hours
Regular working hours
Job source

Tech stack

Amazon Web Services Big Data Data Validation Data Transformation Data Systems Distributed Systems JSON Python (Programming Language) Power BI Data Streaming Unstructured Data Sql Optimization
+6 more
Git Pyspark Data Analytics Data Delivery Data Pipelines Databricks

Job description

In this capacity, you will serve as a critical technical partner to our software developers, data analysts, and data scientists, ensuring an optimal and consistent data delivery architecture across all ongoing projects. We are seeking a professional who is comfortable supporting the diverse data requirements of multiple teams, systems, and products simultaneously., * Develop and operationalize scalable, reliable data pipelines to ensure seamless data flow.

  • Assemble large, complex datasets designed to meet both functional and non-functional business requirements.
  • Apply advanced techniques in database management, including logical data modeling, physical database optimization, and security protocols.
  • Continuously improve the integrity of data pipelines by implementing comprehensive Data Quality checks.
  • Partner with Data and Analytics experts to drive greater functionality and innovation within our data systems.
  • Provide On-Call support to identify and unblock user issues based on system severity.

Requirements

Plan A Technologies is looking for a highly experienced and self-directed Data Engineer to spearhead the construction, optimization, and maintenance of our cloud-based distributed computing data pipelines. The successful candidate will be an expert “data wrangler” capable of understanding and optimizing complex data systems from the ground up., Please note: you must have at least 5+ years of experience in Engineering and Operationalizing Data Pipelines with large and complex datasets to be considered for this role., * 5+ years of experience in Engineering and Operationalizing Data Pipelines with large and complex datasets.

  • 3+ years of professional experience working with unstructured data formats (JSON).
  • Extensive experience in Advanced SQL and 3+ years of experience with Python/PySpark.
  • 3+ years of experience transforming data using Databricks and working within the AWS ecosystem.
  • Proven experience with GIT and CI/CD methodologies.
  • Proficiency with Power BI or similar data visualization platforms.
  • Excellent communication and collaboration skills.
  • Strong analytical, organizational, and detail-oriented mindset.
  • Excellent verbal and written English communication skills.
  • Initiative and drive to do great things.

About the company

Plan A Technologies is an American software development and technology advisory firm that brings top-tier engineering talent to clients around the world. Our software engineers tackle custom product development projects, staff augmentation, major integrations and upgrades, and much more. The team is far more hands-on than the giant outsourcing shops, but still big enough to handle major enterprise clients.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.indeed.com

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

6:21 min

Investigating push inefficiencies with upstream Git experts

Jonathan Creamer · Coffee With Developers

3:47 min

Exploring JSON, CBOR, and JOSE for data serialization

Aaron Russell · LIVE

4:32 min

Harnessing Spark with Python using PySpark and Py4J

Ayon Roy · LIVE

2:57 min

Core technical practices for robust data engineering

Sandhya Menon Sandhya Menon · WWC Europe 2026

3:37 min

Scaling machine learning pipelines from prototypes to petabytes

Julian Joseph · LIVE

56 sec

Favorite git commands and the importance of patch commits

Eileen Uchitelle Eileen Uchitelle +1 · Coffee With Developers

Videos

See all

Related articles

See all