> Markdown version of [/jobs/ext/1914765-data-engineer](https://www.wearedevelopers.com/jobs/ext/1914765-data-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Data Engineer - **Company:** Phaxis LLC - **Location:** Edison, NJ, United States - **Experience:** Expert - **Salary:** $140,000.0 - $170,000.0 - **Contract:** Permanent contract - **Skills:** Application Programming Interfaces (APIs), Airflow, Amazon Web Services, Amazon S3, Data Analysis, Microsoft Azure, Big Data, BigQuery, Cloud Computing, Databases, Continuous Delivery, Continuous Integration, Information Engineering, Data Files, Data Integration, Extract Transform Load (ETL), Dataspaces, Data Systems, Data Warehousing, DevOps, Distributed Computing Environment, Electronic Data Interchange (EDI), Python (Programming Language), Performance Tuning, Systems Development Life Cycle, Software Engineering, SQL Databases, Data Streaming, Enterprise Data Management, Data Processing, Scripting, Enterprise Software Applications, Data Storage Technologies, Snowflake, Apache Spark, Reliability of Systems, Data Lakes, Pyspark, Information Technology, Deployment Automation, Data Management, Data Pipelines, Serverless Computing, Databricks, Programming Languages - **Published:** August 4, 2026 - **Apply:** https://www.careerbuilder.com/job-details/sr-data-engineer-with-python-databricks-edison-nj--bb9205a5-e2be-46b7-89ba-b4ecbdeb347f ## About the Role * Bachelor's or Master's degree in Computer Science, Data Engineering, or a related technical field. * Advanced proficiency in Python and SQL for data manipulation, transformation, and automation. * Deep experience with Databricks, including Spark optimization, Delta Lake management, job orchestration, and workspace administration. * Strong understanding of distributed data processing, partitioning strategies, and performance tuning in Databricks and Spark. * Demonstrated experience designing and implementing enterprise-scale data integrations across Databricks, cloud platforms (AWS, Azure, or GCP), enterprise applications, APIs, and modern data ecosystems. * Hands-on experience with cloud platforms (AWS, Azure, or GCP) and their data ecosystems (e.g., S3, ADLS, BigQuery, Snowflake). Skills: Amazon Web Services (AWS), Application Programming Interface (API), Automation, Best Practices, Cloud Computing, Computer Science, Continuous Deployment/Delivery, Continuous Integration, Data Analysis, Data Management, Data Partitioning, Data Processing, Data Quality, Data Science, Data Sets, Data Storage, Data Warehousing, Database Extract Transform and Load (ETL), DevOps, Ecosystems, Enterprise Applications, Enterprise Data Integration, GCP (Good Clinical Practices), Microsoft Windows Azure, Performance Tuning/Optimization, Python Programming/Scripting Language, SQL (Structured Query Language), Scala Programming Language, Scalable System Development, Software Engineering, Systems Reliability, Validation Testing ## Description This role focuses on building efficient data pipelines, implementing best practices in data engineering, and ensuring system reliability and performance. The Data Engineer works closely with data scientists, analysts, and software engineers to deliver optimized data solutions for both batch and real-time processing., * Design, develop, and maintain end-to-end data pipelines and ETL/ELT workflows using Python, SQL, and modern orchestration tools (e.g., Airflow, dbt). * Architect and optimize data storage solutions, including data lakes and data warehouses, using Databricks, Delta Lake, and cloud-native services. * Build scalable data processing solutions leveraging Databricks notebooks, jobs, and clusters for both batch and streaming data workloads. * Develop and manage Databricks workflows using Spark (PySpark, SQL, or Scala) to transform, cleanse, and aggregate large datasets. * Design, develop, and implement complex data integrations across Databricks, cloud platforms (AWS, Azure, or GCP), enterprise applications, APIs, and modern data ecosystems to enable reliable, scalable data exchange and processing. * Implement data quality checks, schema validation, and monitoring to ensure data accuracy and reliability. * Optimize Databricks cluster configurations and job performance to minimize cost and maximize throughput. * Collaborate with DevOps teams to automate deployments, CI/CD pipelines, and infrastructure-as-code (IaC) for data systems. ## Related Videos - [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works) - [PySpark - Combining Machine Learning & Big Data](https://www.wearedevelopers.com/videos/44-pyspark-combining-machine-learning-big-data) - [Data Science in Retail](https://www.wearedevelopers.com/videos/586-data-science-in-retail) - [From DevOps to Scaled DevOps: How We’re Rebuilding Continuous Delivery as a Platform](https://www.wearedevelopers.com/videos/100018-from-devops-to-scaled-devops-how-we-re-rebuilding-continuous-delivery-as-a-platform) - [Enjoying SQL data pipelines with dbt](https://www.wearedevelopers.com/videos/823-enjoying-sql-data-pipelines-with-dbt) - [Empowering Retail Through Applied Machine Learning](https://www.wearedevelopers.com/videos/976-empowering-retail-through-applied-machine-learning) ## Related Articles - [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know) - [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story) - [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk) - [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers) - [The Most Popular IT Jobs on the Market](https://www.wearedevelopers.com/magazine/376-the-most-popular-it-jobs-on-the-market) - [Top-Paying Tech Jobs (with Salaries)](https://www.wearedevelopers.com/magazine/372-top-paying-tech-jobs-with-salaries)