Lead Software Engineer-0341
Role details
Job location
Tech stack
Job description
DUTIES: Provide technical leadership in building and maintaining the data infrastructure and products for platform; process continuous data streams in near real-time using Apache Flink; use Prometheus and Grafana for tracking system health and alerts; use Flink, Spark, HBase, Azkaban, and Airflow for ETL and building data pipelines; collect and move large volumes of data using Apache Kafka; store data, run servers, monitor logs, and manage permissions using AWS Data Stack, including S3, EC2, CloudWatch, and IAM; automate tasks in Unix environment using Linux CLI and Bash; support applications under development and customize current applications; assist with the software update process for existing applications, and roll-outs of software releases; analyze, test, and assist with the integration of new applications; document all development activity; research, write, and edit documentation and technical requirements, including software designs, evaluation plans, test results, technical manuals, and formal recommendations and reports; monitor and evaluate competitive applications and products; review literature, patents, and current practices relevant to the solution of assigned projects; collaborate with project stakeholders to identify product and technical requirements; conduct analysis to determine integration needs; work with the Quality Assurance team to determine if applications fit specification and technical requirements; and guide and mentor junior-level engineers. Position is eligible to work remotely one or more days per week, per company policy.
Requirements
REQUIREMENTS: Bachelor's degree, or foreign equivalent, in Computer Science, Engineering, or related technical field, and seven (7) years of experience processing continuous data streams using Apache Flink; using Prometheus and Grafana for monitoring and alerting; of which five (5) years includes using Flink, Spark, HBase, Azkaban, and Airflow for building data pipelines and performing ETL; of which three (3) years includes handling real time data feeds using Apache Kafka; storing data, running servers, monitoring logs, and managing permissions using AWS Data Stack, including S3, EC2, CloudWatch, and IAM; and automating tasks in Unix environment using Linux CLI and Bash.