Data Engineer

Building and supporting large-scale, business critical systems on Public Cloud Platform (Google Cloud Platform). Apply Data Engineering concept in large IT projects utilizing in Big Data/Hadoop Eco Systems. Develop and implement technical efforts to design, build, and deploy Cloud applications at the direction of lead architects, including large-scale data processing. Design and build production data pipelines from data ingestion to consumption within a hybrid big data architecture, using GCP Data Engineering & Python/Pyspark. Design, build and maintain Java based REST API's to expose data and integrate with downstream applications. Collaborating with engineering and development teams to evaluate and identify optimal cloud solutions. Identifying, analyzing, and resolving infrastructure vulnerabilities and application deployment issues. Ability to mentor lower-level engineers with 1-2 years of work experience.

Minimum Requirements: Degree in computer/science/engineering related. MS (3YRS) or BS (5YRS) of work experience in data engineering. Position requires expertise in GCP Data Engineering; Hadoop & Big Data Technologies (Hive, Spark, Unix Scripting);Java API development; Cloud Technologies; Python, Pyspark, Aginity Pro, and Agile methodologies. Ability to mentor data engineering teams.