> Markdown version of [/jobs/ext/3549065-postion-data-engineer](https://www.wearedevelopers.com/jobs/ext/3549065-postion-data-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Postion: Data Engineer - **Company:** Brilliant - **Location:** Edison, NJ, United States - **Contract:** Permanent contract - **Skills:** Application Programming Interfaces (APIs), Airflow, Amazon Web Services, Microsoft Azure, Big Data, Databases, Data Architecture, Data Integration, Extract Transform Load (ETL), Data Transformation, Data Security, Data Systems, Data Visualization, Data Warehousing, Relational Databases, Database Theory, Apache Hadoop, Python (Programming Language), Power BI, Cloud Services, SQL Stored Procedures, SQL Databases, Tableau (Software), Unstructured Data, Data Processing, Freeform SQL, Google Cloud, Azure Data Factory, Snowflake, Apache Spark, Git, Data Lakes, Pyspark, Information Technology, AWS Glue, Data Analytics, Apache Kafka, Stream Processing, Data Pipelines, Databricks, Programming Languages - **Published:** October 2, 2026 - **Apply:** https://www.dice.com/job-detail/a439853e-b0d8-4b76-a439-4326a2290964 ## About the Role * Strong proficiency in SQL and relational databases. * Hands-on experience with Python, PySpark, or similar programming languages. * Experience with ETL/ELT tools and data pipeline development. * Experience with cloud platforms such as AWS, Azure, or Google Cloud Platform. * Knowledge of data warehousing concepts and technologies. * Experience with technologies such as Snowflake, Databricks, Azure Data Factory, AWS Glue, or Redshift. * Experience working with Apache Spark/PySpark. * Strong understanding of data modeling, data integration, and database concepts. * Experience with Git and CI/CD practices. * Good understanding of data security, governance, and data quality., * Bachelor's degree in Computer Science, Information Technology, Engineering, Data Science, or a related field. * Experience with Kafka or other real-time data streaming technologies. * Knowledge of dbt, Airflow, or similar data orchestration tools. * Experience with data visualization tools such as Power BI or Tableau. * Experience working with modern cloud data architectures and lakehouse platforms. * Relevant certifications in AWS, Azure, Google Cloud Platform, Databricks, or Snowflake. ## Description We are looking for a skilled Data Engineer to design, develop, and maintain scalable data pipelines and data solutions. The ideal candidate should have strong experience with data integration, ETL/ELT processes, cloud data platforms, databases, and data analytics technologies., * Design, develop, and maintain scalable data pipelines and ETL/ELT workflows. * Develop and optimize data integration solutions for structured and unstructured data. * Work with cloud data platforms such as AWS, Azure, or Google Cloud Platform (Google Cloud Platform). * Build and maintain data warehouses, data lakes, and lakehouse solutions. * Develop complex SQL queries, stored procedures, and data transformation processes. * Work with big data technologies such as Spark, Databricks, or Hadoop. * Implement data quality, validation, governance, and security processes. * Integrate data from APIs, databases, applications, and other enterprise data sources. * Optimize data pipelines and queries for performance, scalability, and reliability. * Collaborate with Data Scientists, Data Analysts, Software Engineers, and business teams to understand data requirements. * Monitor data pipelines and troubleshoot data processing and integration issues. * Maintain technical documentation for data architecture, pipelines, workflows, and processes. ## Related Videos - [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works) - [Fully Orchestrating Databricks from Airflow](https://www.wearedevelopers.com/videos/336-fully-orchestrating-databricks-from-airflow) - [PySpark - Combining Machine Learning & Big Data](https://www.wearedevelopers.com/videos/44-pyspark-combining-machine-learning-big-data) - [How a Small Team Shrank a Microsoft Monorepo by 94%](https://www.wearedevelopers.com/videos/1236-how-a-small-team-shrank-a-microsoft-monorepo-by-94) - [Data Science in Retail](https://www.wearedevelopers.com/videos/586-data-science-in-retail) - [Empowering Retail Through Applied Machine Learning](https://www.wearedevelopers.com/videos/976-empowering-retail-through-applied-machine-learning) ## Related Articles - [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know) - [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk) - [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story) - [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers) - [Top-Paying Tech Jobs (with Salaries)](https://www.wearedevelopers.com/magazine/372-top-paying-tech-jobs-with-salaries) - [The Most Popular IT Jobs on the Market](https://www.wearedevelopers.com/magazine/376-the-most-popular-it-jobs-on-the-market)