Data Engineer

Canyon Associates

United States

4 days ago

Apply on www.dice.com

Prepare application

Role details

Contract type

Permanent contract

Employment type

Full-time (> 32 hours)

Experience level

Expert

Experience required

5 years minimum

Working hours

Regular working hours

Job source

www.dice.com

Tech stack

Artificial Intelligence Amazon Web Services Business Analytics Applications Bash Shell Big Data C++ (Programming Language) Databases Data Integration Extract Transform Load (ETL) Data Warehousing Relational Databases Linux

+25 more

Markup Languages Apache Hadoop Hadoop Distributed File System Industry Standard Architecture JSON Python (Programming Language) PostgreSQL Machine Learning MySQL NoSQL SQL Databases Unstructured Data Extensible Markup Language (XML) YAML Data Processing Scripting Apache Yarn Sql Optimization Large Language Models Snowflake Apache Spark Information Technology Apache Kafka Sql Tuning Programming Languages

Requirements

Significant experience in designing and developing data warehouses and ETL pipeline.
Strong expertise in SQL/Advanced SQL and working with relational database systems (MySQL, PostgreSQL, Snowflake, or similar).
Strong expertise with one or more programming language(s) (C++, Python).
Strong expertise in Linux/UNIX and bash shell scripting.
Significant experience processing large amounts of structured and unstructured data, including integrating data from multiple sources.
Significant experience with SQL performance tuning.
Experience with markup languages (JSON, XML, YAML).
Experience with NoSQL, Time Series (OneTick) databases a strong plus.
Experience with AI/ML technologies, including LLM-based agents, and workflow automation platforms (e.g., AWS Bedrock, n8n) a plus.
Experience with market data protocols and structures (e.g., FIX, exchange order book / top-of-book data) a plus.
Experience mentoring or guiding junior engineers a plus.
Familiarity with Big Data Frameworks/Hadoop-based technologies (e.g., Spark, HDFS, Kafka, Yarn, etc.) a plus.
Well versed in industry standard architecture design methodologies, dimensional data modeling and processes.
Strong written and oral communication skills.
Self-directed and motivated to work in a fast-paced team-oriented environment., * Minimum of a Bachelor s degree or equivalent in Computer Science or Engineering or other relevant field.
Master s degree (e.g., M.S., M.B.A.) or equivalent is preferred but not required.
5+ years of experience building ETL and related data processing and transformation technologies to build large-scale data analytics solutions.
Financial industry experience a plus.