> Markdown version of [/jobs/ext/2835574-data-engineer](https://www.wearedevelopers.com/jobs/ext/2835574-data-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Data Engineer - **Company:** Intellisoft Inc - **Location:** Parsippany-Troy Hills, NJ, United States - **Experience:** Expert - **Contract:** Temporary contract - **Skills:** Amazon Web Services, Data Analysis, Microsoft Azure, Big Data, Continuous Integration, Information Engineering, Data Infrastructure, Extract Transform Load (ETL), Python (Programming Language), NumPy, Standard Sql, Data Streaming, Management of Software Versions, Feature Engineering, GitHub Copilot, Pandas, Data Lakes, Pyspark, Deployment Automation, Bitbucket, Jenkins, Databricks - **Published:** September 10, 2026 - **Apply:** https://www.dice.com/job-detail/78b4e119-d038-480d-ae2e-21a3cf36bfd2 ## About the Role * Top Must-Haves: * **-30% cleaning and handle, 30% building the pipeline, 30 % analytical skills * 7+ years (around that) of experience in Data Engineering or Data Platform development. * Finance or payroll domain experience is ideal- understands payroll data structures, pay period logic, compensation/deduction relationships, or has worked in financial services data environments. * Experience handling large-scale datasets (billions of records, multi-TB, time-series data). * Aws cloud experience (or azure cloud if databricks exp is there) * Strong Databricks proficiency with deep understanding of: * Unity Catalog (governance, access patterns, catalog/schema design) * Delta Lake internals (optimization, clustering, change data feed, versioning) * Databricks Workflows (orchestration, dependencies, monitoring) * Databricks Asset Bundles (Declarative automation bundles) or equivalent deployment frameworks * Exposure to architecture-level design decisions (can participate in architecture discussions, understands tradeoffs). * Strong proficiency in: * Python * SQL * PySpark * Data Modeling * ETL/ELT Development Analytical fluency: exploratory data analysis, basic statistical concepts (correlation, distributions, time-series patterns), feature engineering support. Proficiency with pandas/numpy for ad-hoc analytical work alongside production PySpark. CI/CD implementation experience (Bitbucket Pipelines, Jenkins, automated deployment). Proficiency with AI-assisted development tools (GitHub Copilot, Amazon Q, Kiro, or equivalent). Data quality and validation frameworks ## Related Videos - [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works) - [Vectorize all the things! Using linear algebra and NumPy to make your Python code lightning fast.](https://www.wearedevelopers.com/videos/562-vectorize-all-the-things-using-linear-algebra-and-numpy-to-make-your-python-code-lightning-fast) - [Advanced Typing in TypeScript](https://www.wearedevelopers.com/videos/496-advanced-typing-in-typescript) - [The Road to MLOps: How Verivox Transitioned to AWS](https://www.wearedevelopers.com/videos/1050-the-road-to-mlops-how-verivox-transitioned-to-aws) - [Data Science on Software Data](https://www.wearedevelopers.com/videos/162-data-science-on-software-data) - [Our GitOps approach for deploying an Identity Provider and an API Gateway in a SaaS company](https://www.wearedevelopers.com/videos/776-our-gitops-approach-for-deploying-an-identity-provider-and-an-api-gateway-in-a-saas-company) ## Related Articles - [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk) - [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers) - [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story) - [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know) - [How to Become an AI Engineer](https://www.wearedevelopers.com/magazine/331-how-to-become-an-ai-engineer) - [Coffee with Developers - Maria Apazoglou - Making AI understandable for all in production](https://www.wearedevelopers.com/magazine/475-coffee-with-developers-maria-apazoglou-making-ai-understandable-for-all-in-production)