> Markdown version of [/jobs/ext/4622453-data-software-engineer-staff](https://www.wearedevelopers.com/jobs/ext/4622453-data-software-engineer-staff). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Data Software Engineer Staff - **Company:** Panasonic Avionics Corporation - **Location:** Irvine, CA, United States - **Experience:** Experienced - **Salary:** $112,000 - $188,000 - **Contract:** Permanent contract - **Skills:** Amazon Web Services, Data Analysis, Batch Processing, Big Data, Cascading, Cloud Computing, Databases, Computer Engineering, Data Files, Data Infrastructure, Extract Transform Load (ETL), Data Transformation, Data Systems, Data Warehousing, Database Storage Structures, Database Theory, Elasticsearch, Apache Hadoop, Hadoop Distributed File System, MapReduce, Apache Hive, Python (Programming Language), MySQL, Message Queuing Telemetry Transport (MQTT), NoSQL, Performance Tuning, Ruby, DataOps, Software Deployment, SQL Databases, Data Processing, Apache Spark, Git, Amazon Relational Database Service, Information Technology, Data Programming, Data Management, Stream Processing, Data Pipelines, Amazon Elastic Mapreduce (EMR), Jenkins, Amazon Redshift, Programming Languages - **Published:** November 7, 2026 - **Apply:** https://dejobs.org/x/x/511C612CA9844A12B28741E9D9003446/job/ ## About the Role * Bachelor's degree in computer science, computer engineering, or a related technical field. * 8+ years of professional experience as a data software engineer; or 12+ years of related experience as a data software engineer in lieu of Bachelor's degree. * 2+ years of experience with AWS cloud computing design, provisioning, and tuning. * Related AWS certification, preferred. * Previous experience as a Data Engineer / Database Administrator and/or Business Intelligence Analyst. * Proven knowledge of database concepts, object and data modeling techniques and design principles. * Proven knowledge of database architectures, software, and facilities. * Advanced experience with programming languages - Python (required), Scala, Ruby, R Database technologies - SQL, performance tuning concepts, AWS RDS, RedShift, MySQL. * Advanced experience with big data batch processing tools: Hadoop MapReduce, ElasticSearch, PIG, Hive, Cascading/Scalding, Apache Spark, AWS EMR. * Advanced experience with stream-processing systems: Kinesis, Kafika, MQTT. * Advanced experience with relational NoSQL databases including DyanamoDB Code/Build/Deployment - git, jenkins, aws code. * Excellent verbal and written communication skills necessary to effectively collaborate in a team environment and present and explain technical information and provide advice to management. * Leads complex issues where analysis of situations or data requires an in-depth evaluation of variable factors. Exercises judgment in selecting methods, techniques and evaluation criteria for obtaining results. * Proven experience in complex technical and business matters. * Ability to champion significant projects, programs and business initiatives using demonstrated creativity and ingenuity. * Ability to lead and mentor junior engineers and colleagues. ## Description The Data Software Engineer Staff will be responsible for all aspects of data acquisition, data transformation, analytics and operationalization to drive high-visibility, cross-division outcomes. Lead investigation, evaluation, testing initiatives. Support software developers, database architects, data scientists on data initiatives and will deliver optimal data solutions. What we are looking for: Data Operations * Develop distributed, scalable, and reliable data pipelines that ingest and process data at scale and in real-time. * Create data environments and/or data sets to serve a wide range of data users, including but not limited to Data Scientists, Data Analysts, Business Analysts etc * Perform offline analysis of large data sets using components of a big data software ecosystem. * Troubleshoot and determine root cause of complex data provenance, metadata issues and engineering questions that may involve interfacing with various technical staff in multiple organizations and with differing levels of expertise. * Investigate, evaluate, test and recommend technical solutions for future systems. * Author extract, transform and load (ETL) scripts for moving and curating data into data sets for storage and use by a datalake, data warehouse and datamart. Data Management * Own product features from the development phase through to production deployment (end-to-end). * Provide solutions for the design and implementation of Hadoop EMR Cluster/ Big Data Infrastructure. * Deploy Hadoop/Big Data/Spark and database storage Infrastructures in AWS cloud. * Evaluate big data technologies and prototype solutions to improve data processing architecture. * Monitor and install HDFS/Hadoop/Spark and related software releases, third-party utilities with emphasis on overall system performance. * Develop tools and procedures to monitor and automate system tasks on servers and clusters. * Collaborate with other teams to design, develop, and deploy data tools that support both operations and product use cases. * Evaluate and advise on technical aspects of open work requests in the product backlog with the project lead.