> Markdown version of [/jobs/ext/232845-senior-data-engineer](https://www.wearedevelopers.com/jobs/ext/232845-senior-data-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Senior Data Engineer - **Company:** COMFRT LLC - **Location:** United States (Remote available) - **Experience:** Expert - **Contract:** Permanent contract - **Skills:** Java (Programming Language), Third Normal Form, Artificial Intelligence, Airflow, Amazon Web Services, Amazon S3, Data Analysis, Microsoft Azure, Big Data, BigQuery, Cloud Computing, Cloud Storage, Data Architecture, Information Engineering, Data Governance, Data Infrastructure, Extract Transform Load (ETL), Data Systems, Data Warehousing, Dimensional Modeling, Distributed Computing Environment, Python (Programming Language), Machine Learning, Performance Tuning, Azure Data Lake, Scala (Programming Language), Software Engineering, SQL Databases, Workflow Management Systems, Google Cloud, Snowflake, Apache Spark, Caching, Git, Cloudformation, Build Management, Data Lakes, Infrastructure Automation Frameworks, Information Technology, Dask, Google Bigquery, Apache Kafka, Data Management, Machine Learning Operations, Terraform, Stream Processing, Looker Analytics, Software Version Control, Data Pipelines, Serverless Computing, Amazon Redshift, Programming Languages - **Published:** May 30, 2026 - **Apply:** https://www.indeed.com/viewjob?jk=6d5878406660b75c ## About the Role Do you have experience in Version control systems?, We are seeking a highly skilled and experienced Senior Data Engineer to join our growing data team. The ideal candidate will be responsible for designing, developing, and optimizing our data pipeline architecture to support our analytics, machine learning, and business intelligence initiatives. This role requires a strong background in big data technologies, cloud infrastructure, and a passion for building robust, scalable, and efficient data solutions., * Bachelor's or Master's degree in Computer Science, Engineering, or a related quantitative field. * 5+ years of professional experience in data engineering, software engineering, or a related role focused on data infrastructure. * Proven experience designing and building production-grade, highly reliable, and scalable data pipelines. Technical Skills * Expert proficiency in SQL and at least one high-level programming language (e.g., Python, Scala, Java). * Deep expertise with major cloud platforms (AWS, GCP, or Azure), specifically their data and storage services (e.g., S3, Google Cloud Storage, Azure Data Lake Storage). * Solid experience with modern data warehousing solutions (e.g., Snowflake, Google BigQuery, Amazon Redshift). * Experience with workflow orchestration tools (e.g., Apache Airflow, Dagster). * Familiarity with distributed data processing frameworks (e.g., Apache Spark, Dask). * Experience with version control systems (e.g., Git). * Experience with AI tools(Claude, Vertex AI, Gemini) * Hands-on experience with Looker - building and maintaining LookML models, explores, views, dimensions, measures, and derived tables in a production environment * Proficiency in LookML - including explores, joined views, PDTs (persistent derived tables), liquid templating, and Looker permissions/access controls * Strong understanding of Looker best practices: explore design, field naming conventions, caching strategies, and performance optimization Preferred Qualifications * Experience with stream processing technologies (e.g., Apache Kafka, Kinesis, Pub/Sub). * Exposure to GenAI Integration with development process * Knowledge of data modeling techniques (e.g., 3NF, Dimensional Modeling). * Familiarity with machine learning pipelines (MLOps). * Experience with infrastructure-as-code tools (e.g., Terraform, CloudFormation). * Experience/Familiarity with D2C/E-Commerce Domain Key Competencies * Problem-Solving: Exceptional analytical and problem-solving skills with a high degree of attention to detail. * Communication: Excellent verbal and written communication skills, with the ability to explain complex technical concepts to non-technical audiences. * Ownership: A proactive mindset and a strong sense of ownership over the data platform and its integrity. ## Description Data Architecture and Development * Design, construct, install, test, and maintain highly scalable data management systems and processing pipelines using cloud-native services (e.g., AWS, GCP, Azure). * Develop and optimize ETL/ELT processes to ingest, transform, and load data from various internal and external sources into our data warehouse/data lake. * Implement data governance, security, and quality controls across all data pipelines. * Ensure data architecture supports the needs of data scientists, analysts, and other business stakeholders. Analytics Engineering & BI * Design and build Looker explores, views, and dashboards using LookML to serve self-service analytics across business domains including Revenue, CX, Operations, Logistics, and Finance * Develop and maintain LookML models following best practices: well-structured explores, reusable dimension/measure sets, PDTs, and derived tables * Partner with stakeholders to translate business questions into Looker explores and dashboards that drive operational decisions * Define and enforce reporting standards including MoM, YoY, and Forecast vs Budget vs Actual across all dashboards Optimization and Performance * Monitor, tune, and optimize data warehouse performance (e.g., Snowflake, BigQuery, Redshift). * Troubleshoot and resolve complex data-related issues and performance bottlenecks in the data platform. * Drive continuous improvement in data platform reliability, efficiency, and cost management. Collaboration and Mentorship * Collaborate closely with data scientists, software engineers, and product managers to understand data requirements and deliver solutions. * Define and enforce best practices for data engineering, including coding standards, documentation, and operational procedures. * Mentor and guide junior data engineers, fostering a culture of technical excellence and continuous learning. ## Related Videos - [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works) - [How a Small Team Shrank a Microsoft Monorepo by 94%](https://www.wearedevelopers.com/videos/1236-how-a-small-team-shrank-a-microsoft-monorepo-by-94) - [Enjoying SQL data pipelines with dbt](https://www.wearedevelopers.com/videos/823-enjoying-sql-data-pipelines-with-dbt) - [AI Model Management Life Circles: ML Ops For Generative AI Models From Research to Deployment](https://www.wearedevelopers.com/videos/1152-ai-model-management-life-circles-ml-ops-for-generative-ai-models-from-research-to-deployment) - [Git for Code Reviews](https://www.wearedevelopers.com/videos/429-git-for-code-reviews) - [Modern Data Architectures need Software Engineering](https://www.wearedevelopers.com/videos/1030-modern-data-architectures-need-software-engineering) ## Related Articles - [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers) - [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk) - [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story) - [Fully Remote Software Engineer Jobs](https://www.wearedevelopers.com/magazine/447-fully-remote-software-engineer-jobs) - [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know) - [Is Software Engineering Over-Saturated?](https://www.wearedevelopers.com/magazine/418-is-software-engineering-over-saturated)