> Markdown version of [/jobs/ext/1424624-sr-data-engineer](https://www.wearedevelopers.com/jobs/ext/1424624-sr-data-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Sr. Data Engineer - **Company:** Concora Credit Inc. - **Location:** Beaverton, OR, United States - **Experience:** Expert - **Contract:** Permanent contract - **Skills:** Business Analytics Applications, Data Analysis, Microsoft Azure, Big Data, Cloud Computing Security, Continuous Delivery, Data Architecture, Information Engineering, Data Governance, Data Infrastructure, Extract Transform Load (ETL), Data Systems, Software Design Patterns, Distributed Computing Environment, Information Lifecycle Management, Python (Programming Language), Machine Learning, Meta-Data Management, Performance Tuning, Role-Based Access Control, Power BI, Azure Data Lake, SQL Databases, Data Streaming, Systems Integration, Enterprise Data Management, Azure Service Bus, Data Classification, Apache Spark, Data Lakes, Pyspark, Infrastructure Automation Frameworks, Storage Technologies, Apache Kafka, Data Management, Tools for Reporting, Data Pipelines, Databricks - **Published:** July 24, 2026 - **Apply:** https://www.indeed.com/viewjob?jk=52002b1e8a05a1dd ## About the Role * 5+ years of experience in Data Engineering, Data Platform Engineering, or a related field. * Strong hands-on experience with Databricks, Apache Spark, PySpark, Python, SQL, Azure Data Lake Storage, and Delta Lake. * Deep understanding of distributed data processing and large-scale data architectures. * Strong knowledge of data engineering principles, including data modeling, ETL and ELT design patterns, Data quality and observability, Metadata management, Data lifecycle management, Master Data Management concepts. * Strong understanding of modern table formats and storage architecture. * Experience with performance optimization techniques. * Experience implementing CI/CD and infrastructure automation using tools. * Excellent problem-solving, analytical, and communication skills. * Ability to operate independently while leading initiatives in a fast-paced, agile environment. * Passion for building scalable, maintainable, and well-governed data platforms., * Experience with Unity Catalog, Databricks Workflows, Delta Live Tables / Spark Declarative Pipelines, Structured Streaming, Kafka or Event Hubs. * Experience implementing data governance frameworks and cloud security best practices. * Experience with RBAC, ABAC, data classification, auditing, and compliance controls. * Experience supporting self-service analytics platforms and integrating Databricks with Power BI or other analytics tools. * Experience evaluating and adopting emerging cloud and data platform technologies. * Experience creating engineering standards, reference architectures, and operational best practices for enterprise data platforms. * Experience building and delivering internal training or enablement programs for technical platforms. ## Description * Help design, develop, and optimize scalable data pipelines and data solutions using Databricks, PySpark, SQL, and Python. * Help build and maintain reliable data models and ETL/ELT processes that support analytics, business intelligence, machine learning and AI. * Help establish and maintain data engineering standards, governance, security, and best practices across the Azure and Databricks platforms. * Evaluate new Databricks capabilities and recommend adoption strategies, standards, and implementation patterns. * Monitor, troubleshoot, and optimize data pipelines and platform performance for reliability, scalability, and cost efficiency. * Partner with cross-functional teams to solve complex data challenges and provide technical guidance on data architecture and engineering best practices. * Mentor junior engineers and contribute to a culture of technical excellence and continuous improvement. These duties must be performed with or without reasonable accommodation. We know experience comes in many forms and that many skills are transferable. If your experience is close to what we're looking for, consider applying. Diversity has made us the entrepreneurial and innovative company that we are today. ## Related Videos - [PySpark - Combining Machine Learning & Big Data](https://www.wearedevelopers.com/videos/44-pyspark-combining-machine-learning-big-data) - [Alibaba Big Data and Machine Learning Technology](https://www.wearedevelopers.com/videos/37-alibaba-big-data-and-machine-learning-technology) - [Beyond Dashboards: Fixing Text-to-SQL with Semantic RAG](https://www.wearedevelopers.com/videos/2036-beyond-dashboards-fixing-text-to-sql-with-semantic-rag) - [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works) - [Data Analytics with Microsoft Fabric: End-to-End Use Case with Data Agents](https://www.wearedevelopers.com/videos/1547-data-analytics-with-microsoft-fabric-end-to-end-use-case-with-data-agents) - [Data Science in Retail](https://www.wearedevelopers.com/videos/586-data-science-in-retail) ## Related Articles - [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story) - [Coffee with Developers - Maria Apazoglou - Making AI understandable for all in production](https://www.wearedevelopers.com/magazine/475-coffee-with-developers-maria-apazoglou-making-ai-understandable-for-all-in-production) - [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers) - [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk) - [How We Built a Worry-Free System That Runs for 10+ Years – And What We’d Do Again](https://www.wearedevelopers.com/magazine/751-how-we-built-a-worry-free-system-that-runs-for-10-years-and-what-we-d-do-again) - [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know)