Data Engineer
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Tech stack
+19 more
Job description
- Position Activities and Tasks
- Should be able to design complex and high performance Data architecture
- Developing and maintaining strong relations with senior executives-developing new insights into the clientβs business model and pain points, and delivering actionable, high-impact results
- Participating and leading key engagements, in developing plans and strategies of data management processes and IT programs for the business, providing hands on assistance in data modeling, technical implementation of big data solutions
- Facilitating, guiding, and influencing the clients and teams towards right information technology architecture and becoming interface between Business leadership, Tech leadership and the delivery teams
- Leading and mentoring other developers within the team
- Identify the performance bottle-necks and resolve the same
- Should be able to work in a team
- Ability to produce high quality work products under pressure and within deadlines
- To coordinate with developers / other architects / other stakeholders and cross functional teams from organization
Requirements
Business Model, Customer/Client Research, Information Technology & Information Systems, Data Modeling, Data Management, Big Data, Management Strategy, Strategic Planning, Technical Leadership, Leadership, * 5-7 years of experience in designing and implementing large scale data processing/data storage/data distribution systems
- Extensive experience working with large data sets with hands-on technology skills to design and build robust Big Data solutions using Spark framework, GCP Big data services and industry standard frameworks
- Ability to work with a multi-technology/cross-functional teams and key stakeholders to guide/manage a full life-cycle solution
- Extensive experience in Relational and MPP database platforms like (GCP Bigquery/Hive/Cloud SQL etc)
- Open source Hadoop stack/Spark framework
- Strong understanding of Big Data Analytics platforms and ETL in the context of Big Data
- Excellent problem solving, hands-on engineering skills and communication skills
- Broad understanding and experience of real-time analytics
- Participate in full Software Development Life Cycle (SDLC) of the Big Data Solution
- Process certification, such as, Six Sigma, CBPP, BPM, ISO 20000, ITIL, CMMI.
Technical Skills Required:
- Any combination of below technical skills
- Hadoop : HDFS, MapReduce, Hive, Airflow
- DW : Bigquery, Hive
- Languages : Python, PySpark, Shell Scripting, SQL Scripting
- Cloud : GCP Big data native services
- Any RDBMS/DWBI technologies
- Spark(Mandatory): Spark on GCP Dataproc
Education:
- Bachelorβs degree in a technical field such as computer science, computer engineering or related field required.
Skills:
- MapReduce
- Python
- Bigquery
Benefits & conditions
Pay Transparency: The typical base pay for this role across the U.S. is: $76.00 - $76.92/hr. Non-exempt positions are eligible for overtime at a rate of 1.5 times the base hourly rate for all hours worked in excess of 40 in a work week, or as required by state or local law. Final offer amounts, within the base pay set forth above, are determined by factors including your relevant skills, education and experience. Full-time employees are eligible to select from different benefits packages. Packages may include medical, dental, and vision benefits, health savings accounts with qualified medical plan enrollment, 10 paid days off, 3 days paid bereavement leave, 401(k) plan participation with employer match, life and disability insurance, commuter benefits, dependent care flexible spending account, accident insurance, critical illness insurance, hospital indemnity insurance, accommodations and reimbursement for work travel, and discretionary performance or recognition bonus. Sick leave and mobile phone reimbursement provided based on state or local law.
Consent to Communication and Use of AI Technology: By submitting your application for this position and providing your email address(es) and/or phone number(s), you consent to receive text (SMS), email, and/or voice communication whether automated (including auto telephone dialing systems or automatic text messaging systems), pre-recorded, AI-assisted, or individually initiated from Aditi Consulting, our agents, representatives, or affiliates at the phone number and/or email address you have provided. These communications may include information about potential opportunities and information. Message and data rates may apply. Message frequency may vary. You represent and warrant that the email address(es) and/or telephone number(s) you provided to us belong to you and that you are permitted to receive calls, text (SMS) messages, and/or emails at these contacts. You also acknowledge and agree to Aditi Consulting LLCβs use of AI technology during the sourcing process, including calls from an AI Voice Recruiter. AI is used solely to gather data and does not replace human-based decision-making in employment decisions. Calls may be recorded.
Consent is not a condition of purchasing any property, goods, or services. You may revoke your consent at any time by replying βSTOPβ to :messages or by contacting
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Good distractions
Loading talks and stories from around this roleβ¦