> Markdown version of [/jobs/ext/195269-big-data-engineer](https://www.wearedevelopers.com/jobs/ext/195269-big-data-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Big Data Engineer - **Company:** W. H. GREEN & SONS, INC. - **Location:** Portland, ME, United States - **Experience:** Expert - **Contract:** Permanent contract - **Skills:** Java (Programming Language), Microsoft Azure, Big Data, C++ (Programming Language), Software Quality, Data Files, Extract Transform Load (ETL), Data Transformation, Data Structures, Data Stores, Github, Apache Hadoop, Systems Analysis, NoSQL, Object-Oriented Software Development, Query Optimization, Queueing Systems, Standard Sql, Scala (Programming Language), Unstructured Data, Azure Data Factory, Snowflake, Database Optimization, Apache Spark, Data Lakes, Information Technology, Deployment Automation, Apache Kafka, Build Process, Spark Streaming, Data Management, Stream Processing, Software Version Control, Data Pipelines, Sql Tuning, Databricks - **Published:** May 30, 2026 - **Apply:** https://www.indeed.com/viewjob?jk=0227bae85263e0ce ## About the Role Do you have experience in Systems analysis?, Do you have a Bachelor's degree?, Big Data Engineer with Bachelor Degree in Computer Science, Computer Information Systems, Information Technology, or a combination of education and experience equating to the U.S. equivalent of a Bachelor's degree in one of the aforementioned subjects., * At least 5+ years of experience in building and optimizing Big Data, Data pipelines, architectures and data sets. * Experience in performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement. * Strong analytic skills related to working with unstructured datasets. * Build processes supporting data transformation, data structures, meta data, dependency and workload management. * A successful history of manipulating, processing and extracting value from large disconnected data sets. * Working knowledge of message queuing, stream processing, and highly scalable Big Data, data stores. * Experience in supporting and working with cross-functional teams in a dynamic environment. * Experience with big data tools: Hadoop, Spark, Kafka, etc. * Experience with relational SQL and NoSQL databases, including AzureSQL and Snowflake. * Experience with Azure cloud services: ADLS, AzureSynapse, Azure Databricks, Delta Lake * Experience with stream-processing systems: Storm, Spark-Streaming, etc. * Experience with object-oriented/object function scripting languages: Python, Java, C++, Scala, etc. Work location is Portland, ME with required travel to client locations throughout USA. ## Description * Collaborate with System Architects to design, develop, test, and implement efficient Snowflake data models aligned with enterprise data warehousing standards. * Build and manage cloud and hybrid integrations using third-party ETL tools like Azure Data Factory for seamless Snowflake data pipelines. * Maintain CI/CD pipelines in GitHub and Azure DevOps to ensure code quality, version control, and automated deployment for Snowflake solutions. * Conduct SQL performance analysis, query optimization, and database tuning to improve efficiency and scalability in Snowflake models. * Develop robust, scalable Snowflake integrations and data models following industry best practices. * Perform root cause analysis on data model issues and resolve performance bottlenecks to maintain reliable Snowflake systems. * Engage with customers and architects to refine requirements and communicate effectively for business alignment. * Apply strong time management to prioritize concurrent tasks and deliver Snowflake projects promptly. * Use analytical and problem-solving skills to address complex warehouse challenges within the Snowflake ecosystem. ## Related Videos - [Alibaba Big Data and Machine Learning Technology](https://www.wearedevelopers.com/videos/37-alibaba-big-data-and-machine-learning-technology) - [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works) - [Leveraging Real time data in FSIs](https://www.wearedevelopers.com/videos/806-leveraging-real-time-data-in-fsis) - [Innovating Developer Tools with AI: Insights from GitHub Next](https://www.wearedevelopers.com/videos/1268-innovating-developer-tools-with-ai-insights-from-github-next) - [PySpark - Combining Machine Learning & Big Data](https://www.wearedevelopers.com/videos/44-pyspark-combining-machine-learning-big-data) - [Why and when should we consider Stream Processing frameworks in our solutions](https://www.wearedevelopers.com/videos/1085-why-and-when-should-we-consider-stream-processing-frameworks-in-our-solutions) ## Related Articles - [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk) - [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know) - [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers) - [Data Analyst Salary in the UK](https://www.wearedevelopers.com/magazine/278-data-analyst-salary-in-the-uk) - [A Guide to Green Tech and Green IT Careers](https://www.wearedevelopers.com/magazine/374-a-guide-to-green-tech-and-green-it-careers) - [The Most Popular IT Jobs on the Market](https://www.wearedevelopers.com/magazine/376-the-most-popular-it-jobs-on-the-market)