Cloud Software Engineer

Our client is hiring a Cloud Software Engineer to build and improve large-scale big data cloud systems. The work centers on back-end processing, analytics, and indexing for SIGINT mission data. The engineer works independently or within a team across the full back-end pipeline, from ingest and parsing through analytics and retrieval, and helps shape design decisions at the system level., Big data cloud development:

• Design, build, and extend complex distributed big data cloud applications from documented requirements.
• Contribute to every stage of back-end work, including data processing, analysis, and indexing.

• Write Java applications across the Hadoop ecosystem using sound object-oriented and distributed computing practices.

• Build information retrieval capabilities that make very large data sets searchable and useful to analysts.

Testing and quality:

• Review and test software components against design requirements, and record the results.
• Investigate and close out software problem reports.
• Apply development and design methods suited to the program’s environment.

System design input:

• Advise on the software side of system design, including hardware and software trade-offs and opportunities for reuse.
• Weigh commercial and government off-the-shelf options against building new.
• Break system-level requirements down into requirements for individual software components.

The ideal candidate is a hands-on cloud engineer who is at home deep in the Hadoop stack and understands how SIGINT data moves from collection to analysis.

Required:

• Bachelor’s degree in Computer Science or a related field. Four years of cloud software engineering on comparable big data systems may substitute for the degree.

• 8+ years of software engineering on programs of similar scope and complexity, including at least 2 years on big data cloud or distributed computing programs. A master’s degree may substitute for 2 years of experience, and a Cloudera Certified Hadoop Developer certification may substitute for 1 year of cloud experience.

• 2 years of cloud and distributed computing information retrieval, plus at least 1 year each of: writing code that interacts with cloud Big Table, distributed file system, and distributed coordination framework implementations; and building complex MapReduce analytics.

• Java, object-oriented design and programming, Eclipse or a similar IDE, Maven, and RESTful web services.
• Hands-on work with distributed technologies such as YARN, J2EE, MapReduce, ZooKeeper, HDFS, HBase, JMS, and concurrent programming.
• Information retrieval tools such as HDFS, HBase, Apache Lucene, Apache Solr, or MongoDB.
• Ingesting, parsing, and analyzing data in varied formats, including XML, JSON, CSV, binary, sequence and map files, and Avro.
• Debugging and profiling distributed installations, including JVM memory management and Java application profiling.
• Aspect-oriented design and development.

• Installing and managing cloud and distributed systems across multiple nodes with tools such as Python, CFEngine, Bash, or Ruby, plus virtualization (VMware or VirtualBox), utility computing, and network management.

• Securing cloud and distributed applications with firewalls, PKI certificates, server authentication, and corporate authentication services.

• UNIX/Linux, including CentOS and Red Hat, and configuration management tools such as Subversion, ClearQuest, or Razor.
• Experience in at least one SIGINT collection discipline (FORNSAT, cable, terrestrial/microwave, overhead, or ELINT), along with geolocation, emitter identification, signals characterization, and joint collection platform dataflow architectures.
• TS/SCI with a current Full Scope Polygraph at the time of application.

Desired:

• Deep information retrieval expertise, including guiding a team through IR design, development, and testing.

• Building workflows that orchestrate complex MapReduce analytics.
• Overseeing one or more software development tasks within a defined development process.
• A track record of improving documentation and development process standards.

Base salary is $204,000-$223,000, supported by an exceptionally strong retirement benefit. 401(k): 25% employer contribution, vested immediately ($51,000-$56,000 per year).

Total compensation: $255,000-$279,000 (base salary plus employer 401(k) contributions).