Database Developer
Role details
Job location
Tech stack
Job description
Design, develop, and maintain robust and scalable data solutions within our data lakehouse architecture, leveraging Apache Iceberg for open table format management. Develop and optimize data ingestion, transformation, and curation processes using technologies compatible with Iceberg, Oracle, and Starburst. Utilize Starburst (Trino) for high-performance querying and data virtualization across various data sources, including Iceberg tables and Oracle databases. Work extensively with Oracle databases for enterprise data management, including schema design, stored procedures, performance tuning, and data integration. Collaborate with data architects, data scientists, and business intelligence teams to translate business requirements into technical data models and data solutions. Implement and manage ETL/ELT pipelines to move data efficiently between Oracle, data lake storage (e.g., S3, ADLS), and Iceberg tables. Ensure data quality, integrity, and security across all data platforms, adhering to data governance standards. Perform performance tuning and optimization for queries running on Starburst, Iceberg tables, and Oracle databases. Participate in the evaluation and adoption of new data technologies and best practices to enhance our data platform capabilities. Troubleshoot and resolve complex data-related issues, ensuring high availability and reliability of data infrastructure. Document technical specifications, data flows, data models, and operational procedures. Mentor junior team members and contribute to a culture of continuous learning and improvement.
#CT1
-
Only those lawfully authorized to work in the designated country associated with the position will be considered.
-
Please note that all Position start dates and duration are estimates and may be reduced or lengthened based upon a client's business needs and requirements.
Requirements
Must Have Skills/Attributes: AWS, Azure, ETL, Oracle, PL/SQL, SQL
Experience Desired: Hands-on experience with Apache Iceberg (7-10 yrs); Expertise in Oracle database development (7-10 yrs); Experience with Starburst (Trino) (7-10 yrs); Experience in SQL for complex data manipulation (7-10 yrs); Experience with cloud platforms (e.g., AWS, Azure, Google Cloud Platform) (7-10 yrs)
Required Minimum Education: Bachelor's Degree
Preferred Education: Master's Degree
Preferred Certifications/Licenses: Oracle Certified Professional, AWS Certified Data Analytics
C2C is not available, Bachelor's degree in computer science, Information Systems, Data Engineering, or a related technical field.
Preferred Education Master's degree in a related field., 7-10 years of experience in database development or data engineering roles. 7-10 years of experience with Apache Iceberg for managing large-scale, high-performance table formats in a data lake context. 7-10 years of experience in Oracle database development, including SQL, PL/SQL, schema design, indexing, and performance tuning. Experience with Starburst (Trino) for distributed query processing and federated queries across heterogeneous data sources. Proficiency in SQL for complex data manipulation, analysis, and optimization. Solid understanding of data warehousing concepts, dimensional modeling, and ETL/ELT methodologies. Experience with cloud platforms (e.g., AWS, Azure, Google Cloud Platform) and their data storage services (e.g., S3, ADLS, GCS). Familiarity with distributed data processing frameworks (e.g., Apache Spark, Flink). Experience with version control systems (e.g., Git). Excellent analytical, problem-solving, and communication skills, with the ability to articulate complex technical concepts.
Preferred Skills Experience with other data lake table formats (e.g., Delta Lake, Apache Hudi). Knowledge of other distributed query engines (e.g., Presto, Athena, Dremio). Proficiency in programming languages such as Python or Scala for data engineering tasks. Experience with workflow orchestration tools (e.g., Apache Airflow, Dagster). Familiarity with data governance tools and practices in a data lakehouse environment. Relevant industry certifications (e.g., Oracle Certified Professional, AWS Certified Data Analytics).