Databricks Engineer / Solutions Architect
Role details
Job location
Tech stack
Job description
Thank you for considering IT Concepts dba Kentro, where innovation drives opportunity and collaboration leads to success. Our dynamic community of experts is fully committed to advancing our customers' missions, fostering professional growth, and making a positive impact on our communities.
We are seeking a highly skilled and certified Databricks Engineer / Solutions Architect to lead the greenfield implementation, configuration, and scaling of a new Databricks environment. In this high-impact role, you will design and build a modern data platform tailored to support Management Information and Business Intelligence (MI/BI) operations across our federal customer's extensive contact center network and regional field offices.
As a dual architect and hands-on engineer, you will bridge the gap between complex data engineering, advanced data science, and executive business strategy. You will interface regularly with C-suite and executive personnel to translate complex business needs into scalable technical realities, ensuring our data infrastructure drives real-time operational excellence and predictive customer insights, 1. Databricks Architecture & Implementation
- Greenfield Deployment: Lead the end-to-end design, setup, security configuration, and deployment of a brand-new Databricks workspace environment (Delta Lake/Lakehouse architecture).
- Data Pipeline Engineering: Design, build, and optimize scalable ETL/ELT pipelines to ingest, process, and transform high-volume structured and unstructured data.
- Governance & Security: Implement robust data governance frameworks using tools like Unity Catalog to ensure data compliance, fine-grained access control, and privacy across field offices.
- Domain Analytics & Advanced MI/BI Delivery
- Omnichannel Analytics: Create a unified view of the Customer Journey, mapping out touchpoints across self-service, telephony, field office visits, and digital communication channels.
- Multimodal Data Processing: Architect data pipelines to store, process, and extract insights from both structured data (CRM tables, telephony metrics, interaction logs) and unstructured data (call transcripts, customer feedback strings, chat histories).
- Advanced Databricks Features: Implement and manage native Databricks features covering Artificial Intelligence (AI), Machine Learning (ML), and Natural Language Processing (NLP). This includes leveraging Databricks Mosaic AI, MLflow, and LLM foundation model APIs to deploy predictive customer routing models, sentiment analysis, and automated interaction summaries.
- Executive Stakeholder Engagement & Project Delivery
- Requirements Gathering: Act as the primary technical liaison to discover, document, and refine complex customer and business requirements.
- Executive Presentation: Regularly present technical roadmaps, platform capabilities, and predictive BI insights to executive-level personnel in a clear, non-technical manner.
- Agile Project Management: Work fluidly within product management frameworks using tools like Jira or similar Agile delivery systems to manage sprints, track backlogs, and deliver predictable technical milestones., * Willing and able to obtain and maintain Public Trust Clearance
- Must meet updated ID requirements: https://www.gsa.gov/technology/it-contract-vehicles-and-purchasing-programs/federal-credentialing-services/get-appointment-help/bring-required-documents
- If you do not currently meet the ID requirements outlined, you must be willing and able to update your current forms of ID in a timely manner to complete the suitability process successfully.
This role will initially be engaged as an independent contractor (1099) with the potential to transition to a full-time employee position in the future.
Requirements
Required Education & Experience
-
Education: Bachelor's degree in Computer Science, Data Engineering, Information Systems, or a closely related quantitative field. A Master's degree is highly preferred for this level.
-
Experience:
-
Minimum of 7-10 years of experience in data engineering, data architecture, or big data analytics.
-
At least 3-5 years of hands-on experience architecting and managing enterprise-grade Databricks environments.
Certifications (Mandatory)
-
Must possess at least one of the following active Databricks certifications:
-
Databricks Certified Solutions Architect
-
Databricks Certified Data Engineer Professional
Domain & Technical Competencies (STRONGLY PREFERRED)
- Contact Center Domain & Amazon Connect: Strong preference for candidates with experience handling contact center operational data. Direct experience with Amazon Connect (telephony streams, CTR logs, Contact Lens analytics data) is highly preferred.
- Tooling: Proficient with project management and Agile delivery tracking systems (Jira, Agility, Confluence, or similar tools).
- Core Tech Stack: Expert-level SQL, Python, or Scala; deep understanding of Apache Spark, Delta Lake, and cloud infrastructure integration.
Professional & Security Requirements
- Clearance: Must be a US Citizen or lawful permanent resident capable of successfully passing a background investigation to obtain a Public Trust Clearance.
- Communication: Exceptional verbal, written, and presentation skills, with a proven track record of successfully managing executive-level client relationships.
Technical engineers and non-technical executive leadership.
Benefits & conditions
We offer competitive benefits package including paid time off, healthcare benefits, supplemental benefits, 401k including an employer match, discount perks, rewards, and more. We invest in our employees - Every employee is eligible for education reimbursement for certifications, degrees, or professional development. Reimbursement amounts may fluctuate due to IRS limitations. We want you to grow as an expert and a leader and offer flexibility for you to take a course, complete a certification, or other professional growth and networking. We are committed to supporting your curiosity and sustaining a culture that prioritizes commitment to continuous professional development.