Sr Data Developer
Role details
Job location
Tech stack
Job description
The Connectivity Insights team is responsible for building robust, scalable reporting and analytics solutions for our client's high speed data (internet) and WiFi platforms. The team provides recurring production reports and in-depth analyses on all new and existing products, features, and enhancements that are deployed to their customers ( 30 million internet customers). The team is comprised of lead, senior, and associate developers, as well as management. New team members will join existing team that manages an end-to-end pipeline from data ingestions, aggregations, optimizations, and monitoring to report development, statistical analysis, data science, and presentation of findings. The Sr Data Developer works within the ETL and Operations team to build high quality data pipelines driving analytic solutions from diverse, disparate sources of data. This role requires a comprehensive understanding of data architecture, data engineering, and data analysis. The ideal candidate is a skilled data engineer with experience creating data products supporting analytic solutions. They are able to identify and implement solutions in a highly technical environment and work as part of a technical, cross-functional team. Strong problem-solving and troubleshooting skills are a must.
This role focuses on designing, developing, and maintaining datasets within AWS. Day-to-day responsibilities include: Coordinating, building, and managing new data ingests Architecting updates, fixes, and optimizations across suite of production jobs Providing feedback on and enacting changes for improvements across the team including both technical and process updates Learn and assess new technologies for implementation through proof-of-concept projects and testing Mentoring junior developers Partnering with data analysts and data scientists to design, build, and deploy aggregation processes
Requirements
Applicants must be legally authorized to work in the United States. Sponsorship not available., Hadoop/Spark SQL experience AWS experience (EMR, Lambda, Glue, Step Functions, Airflow) Experience working with large data sets (billions of records per day) Write and review code Python scripting (PySpark, control scripts) Architecting/designing data pipelines Query and data pipeline optimization Strong communication and collaboration skills Ability to help others and mentor junior resources Spark Scala Git Shell scripting Linux
Benefits & conditions
The final salary or hourly wage, as applicable, paid to each candidate/applicant for this position is ultimately dependent on a variety of factors, including, but not limited to, the candidate's/applicant's qualifications, skills, and level of experience as well as the geographical location of the position.