> Markdown version of [/jobs/ext/4637860-azure-data-architect](https://www.wearedevelopers.com/jobs/ext/4637860-azure-data-architect). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Azure Data Architect - **Company:** HCL Technologies - **Location:** Atlanta, GA, United States - **Contract:** Permanent contract - **Skills:** Application Programming Interfaces (APIs), Artificial Intelligence, Audit Trail, Unit Testing, CA Workload Automation Ae, Microsoft Azure, Big Data, Databases, Continuous Integration, Data Architecture, Data Validation, Information Engineering, Data Files, Data Governance, Extract Transform Load (ETL), Data Security, Data Structures, Data Systems, DevOps, Dimensional Modeling, Distributed Systems, Ganglia (Software), Github, Apache Hive, JSON, Job Scheduling, Python (Programming Language), Key Management, Machine Learning, Node.Js, Performance Tuning, Standard Sql, DataOps, Azure Data Lake, Simple Data Format, SQL Databases, Data Streaming, Parquet, Data Logging, Real Time Systems, Azure Data Factory, Autoscaling, Great Expectations (Foster Youth College-readiness and Support Program), Apache Spark, Virtual Environment, Analytic Functions, Caching, Pandas, Pytest, Data Lakes, Pyspark, Semi-structured Data, Integration Tests, Avro, Star Schema, Apache Kafka, Data Management, Machine Learning Operations, Restful APIs, Azure Synapse Analytics, Data Pipelines, Vectorization, Key Vault, Jenkins, Databricks, Control M - **Published:** November 8, 2026 - **Apply:** https://www.careerbuilder.com/job-details/azure-data-architect-atlanta-ga--16ea7a1f-0fdc-45e6-b7ed-c179944b83a1 ## About the Role DataArchitect Data Modeling Tool, Microsoft Windows Azure, Leadership, Mentoring, Best Practices, Architectural Services, Business Strategy, Microsoft Windows Azure, Database Extract Transform and Load (ETL), Apache Spark, Strong experience with Azure Databricks and Spark (PySpark/Scala) Hands-on experience with Azure services (ADF, ADLS, Synapse, Event Hub) Expertise in big data architecture and distributed systems Strong knowledge of SQL, Python, and data engineering concepts Experience with data modeling techniques (star schema, dimensional modeling) Understanding of real-time streaming (Kafka/Event Hub) Knowledge of DevOps and CI/CD practices Strong Development Area: Data Engineering Foundations Batch vs streaming; lakehouse concepts; medallion (Bronze/Silver/Gold); file formats (Parquet/Delta/CSV/JSON/Avro); partitioning & clustering; schema evolution; data governance basics; DevOps/CI-CD for data. SQL Joins, subqueries, CTEs, window functions, set operations; aggregation & rollups; MERGE/UPSERT; analytic functions; performance (indexes, partition pruning, statistics); data validation scenarios (dedupe, top-N, SCD keys). Apache Spark (Core) ## Description The Azure Data Solutions Architect leads the design and implementation of enterprise-scale data solutions using Azure Data Factory, Azure Databricks, and Azure Synapse Analytics. This role provides architectural leadership, ensuring solutions are robust, scalable, and aligned with business strategy and industry best practices. The architect drives innovation, enforces governance, and mentors teams to deliver high-quality, future-ready data platforms that support organizational transformation., Design and implement scalable data architectures using Azure services Build and optimize ETL/ELT pipelines using Azure Databricks and Apache Spark Architect data lake and data warehouse solutions using Azure Data Lake and Azure Synapse Analytics Define data modeling strategies (batch & real-time processing) Ensure data security, governance, and compliance standards Collaborate with stakeholders to understand business requirements and translate them into technical solutions Optimize performance and cost efficiency of data workloads Implement CI/CD pipelines for data engineering workflows Mentor and guide data engineers and development teams Integrate advanced analytics, AI, and ML solutions when required, Spark architecture (driver/executors), DAG, stages/tasks; RDD vs DataFrame/Dataset; wide vs narrow transformations; shuffle mechanics; caching/persistence; partitioning; broadcast joins; skew handling; checkpointing; job tuning. PySpark DataFrame API, Spark SQL; UDF vs pandas UDF; windowing; incremental loads; structured streaming (triggers, watermarks); handling semi-structured data; optimizing with predicates, pushdown, join strategies; error handling; unit testing (pytest + chispa). Databricks Platform Workspace basics; clusters (Single Node/All-Purpose/Jobs), cluster policies; DBR/LTS; notebooks & Repos; Jobs & Workflows; Delta Lake & Delta Live Tables; Unity Catalog (catalog/schema/table, permissions, lineage); MLflow basics; secret scopes; DBFS; REST APIs; Databricks Connect. Delta Lake / Lakehouse Patterns ACID transactions; schema enforcement/evolution; time travel; OPTIMIZE/ZORDER; VACUUM; CDC patterns (MERGE INTO, change data feed); streaming vs batch Delta; expectations/constraints; table maintenance strategies. Orchestration & Scheduling Databricks Workflows; Azure Data Factory/Synapse pipelines; triggers; parameter passing; fail/retry; alerts; integration with AutoSys/Control-M/Jenkins/GitHub Actions; event-driven patterns. Python (Core for Data) Core syntax; typing & data structures; file I/O; logging; virtual environments; packaging; testing (pytest); common data libs (pandas, pyarrow); error handling; performance considerations (vectorization, generators). Data Quality & Testing Great Expectations/dbx expectations or custom checks; unit/integration tests; reconciliation (row/amount); anomaly detection; contract testing for schemas; data observability (metrics, SLAs, freshness). Security & Governance Unity Catalog permissions, row/column-level security; secrets management (Key Vault/Secret scopes); PII handling; audit logs; token management; compliance basics. Cost & Performance Optimization Cluster sizing, autoscaling; DBU awareness; spot/preemptible instances; storage formats; caching; efficient joins; job scheduling; monitoring with metrics & Ganglia/Spark UI; cost tagging and chargeback. Analytical Skills & Problem Solving Break down data problems; root-cause incidents; propose alternatives; estimate complexity; communicate clearly with stakeholders. Stake Holder Management Interaction with Client Stakeholders, Communication. Other Requirements 1. Microsoft Certified: Azure Solutions Architect Expert (Recommended) 2. Microsoft Certified: Azure Data Engineer Associate (Optional But Valuable