Databricks Architect
Computer Task Group, Inc
3 days ago
Role details
Contract type
Temporary contract Employment type
Full-time (> 32 hours) Working hours
Regular working hours Languages
English Experience level
Intermediate Compensation
$ 177KJob location
Remote
Tech stack
API
Artificial Intelligence
Amazon Web Services (AWS)
Amazon Web Services (AWS)
Data analysis
Business Logic
Azure
Google BigQuery
Cloud Computing
Information Systems
Continuous Integration
Data Architecture
Information Engineering
Data Integration
ETL
Data Security
Data Systems
DevOps
Distributed Computing Environment
Systems Analysis
Python
Performance Tuning
SQL Databases
Workflow Management Systems
Cloud Platform System
Spark
AWS Lambda
Amazon Web Services (AWS)
Data Lake
Information Technology
Data Management
Code Restructuring
Data Pipelines
Serverless Computing
Legacy Systems
Databricks
Job description
- Design, develop, and implement scalable data and analytics platforms using Databricks and modern cloud technologies
- Provide technical leadership in architecting end-to-end data solutions supporting data engineering, analytics, AI/ML, and business intelligence use cases
- Translate business and IT requirements into modern data architecture components using established modernization frameworks
- Lead the design and optimization of distributed data processing solutions leveraging Apache Spark and Delta Lake
- Collaborate with data engineers, data scientists, platform engineers, and business stakeholders to deliver secure, reliable, and high-performance solutions
- Define and enforce best practices for data integration, ETL/ELT pipelines, orchestration, and data modeling
- Ensure robust implementation of data security, governance, access control, and compliance within cloud environments
- Perform performance tuning, cluster configuration optimization, and cost management across Databricks environments
- Support DevOps and CI/CD implementation for data platforms and analytics workloads
- Contribute to modernization initiatives including legacy system analysis, code restructuring, refactoring, and business logic extraction into reusable components
- Enable integration of legacy and modern systems using cloud-native services and APIs for reuse by systems of engagement
- Reuse and enhance digital modernization assets, methods, and collateral
- Work with cloud-native services such as AWS ECS, AWS Lambda, ElasticCache, and S3 as applicable
Requirements
- Strong experience designing and implementing data platforms using Databricks
- MUST have familiarity with AI and Machine Learning
- Deep knowledge of Apache Spark, Delta Lake, and distributed data processing concepts
- Proficiency in Python, Scala, or SQL for data engineering and analytics
- Experience with cloud platforms such as Azure (ADF, ADLS), AWS (S3, Glue), or GCP (GCS, BigQuery)
- Hands-on experience with data integration, ETL/ELT frameworks, and orchestration tools
- Strong understanding of data security, governance, and access control in cloud environments
- Experience with performance tuning, cluster configuration, and cost optimization
- Familiarity with DevOps and CI/CD practices for data platforms
- Ability to communicate complex technical concepts to non-technical stakeholders
- Experience with legacy modernization, code refactoring, and integration of legacy systems
Experience:
- 8+ years of experience in data engineering, data architecture, or analytics engineering roles
- 3+ years of hands-on experience with Databricks in production environments
- Proven experience architecting cloud-based data platforms at scale
- Demonstrated experience working on AI/ML-enabled data solutions is required
- Experience leading technical teams or acting as a lead architect in enterprise environments
Education:
- Bachelor's degree in Computer Science, Information Systems, Engineering, or a related field, or equivalent practical experience
Excellent verbal and written English communication skills and the ability to interact professionally with a diverse group are required.
Benefits & conditions
The expected base salary for this position ranges from $80.00 to $85.00/hour. Salary offers are based on a wide range of factors including relevant skills, training, experience, education, market factors, and where applicable, licensure or certifications obtained. In addition to salary, a competitive benefit package is also offered.
About the company
CTG, a Cegeka company, delivers IT and business solutions that enhance clients' digital agility, empowering them to seize new opportunities and overcome any challenge. Backed by more than 60 years' experience and a commitment to being a reliable, results-driven partner, we work shoulder to shoulder with clients to shape digital together. Our vision is to be an indispensable partner to our clients and the preferred career destination for digital and technology experts. With more than 9,000 team members in over 15 countries, we combine global expertise with local insight to deliver innovative solutions. We operate across the Americas, Europe, and India, working with over 3,000 clients in many of today's highest-growth industries.
Together, we shape what's next-working shoulder to shoulder to deliver impactful solutions for our clients and society. Our culture is built by the people who work at CTG, the values we hold, and the actions we take. It's a living, breathing thing that is renewed every day through the ways we engage with each other, our clients, and our communities. At CTG, you'll find a workplace where you are encouraged to grow, supported in your ambitions, and empowered to shape your own career journey. For more information, visit www.ctg.com .
CTG will consider for employment all qualified applicants including those with criminal histories in a manner consistent with the requirements of all applicable local, state, and federal laws.
CTG is an Equal Opportunity Employer. CTG will assure equal opportunity and consideration to all applicants and employees in recruitment, selection, placement, training, benefits, compensation, promotion, transfer, and release of individuals without regard to race, creed, religion, color, national origin, sex, sexual orientation, gender identity and gender expression, age, disability, marital or veteran status, citizenship status, or any other discriminatory factors as required by law. CTG is fully committed to promoting employment opportunities for members of protected classes.