Data Engineer

TEKSYSTEMS INC.
Huntsville, AL, United States
1 day ago
Apply on www.clearancejobs.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Experienced
Experience required
3 years minimum
Working hours
Regular working hours

Tech stack

Java (Programming Language) Artificial Intelligence Airflow Amazon Web Services Microsoft Azure BigQuery Cloud Storage Information Systems Computer Programming Databases Data Hub Extract Transform Load (ETL)
+34 more
Data Security Data Systems Data Warehousing Distributed Data Store Elasticsearch Github Python (Programming Language) Metadata Repositories MongoDB NoSQL Scala (Programming Language) Software Systems Apache Solr SQL Databases Data Streaming Enterprise Data Management Azure Data Factory Delivery Pipeline Snowflake Apache Spark Usage Tracking Data Lakes AWS Glue Complex Event Processing Apache Nifi Data Management Machine Learning Operations Restful APIs Data Pipelines Powerapps Amazon Elastic Mapreduce (EMR) Jenkins Amazon Redshift Databricks

Requirements

  • 5+ years of experience designing data warehouse or data lake, RESTful API models, event processing, or business intelligence for software systems
  • 5+ years of experience building scalable ETL or ELT data pipelines, automating large-scale batch and streaming data workflows, and parsing structured, unstructured, or event-streaming data
  • 5+ years of experience with coding in software programming languages, including SQL, Python, Scala, Spark, or Java
  • Experience performing tuning on data lake architecture to optimize cloud storage and pipeline performance
  • Experience with data management solutions that address aspects of data catalog, data usage, governance policies, and lifecycle management
  • Top Secret clearance
  • Bachelor’s degree and 8+ years of experience designing, developing, operationalizing, and maintaining data systems, or 12+ years of experience designing, developing, operationalizing, and maintaining data systems in lieu of a degree

Nice to Have Skills

  • 3+ years of experience architecting and designing large-scale enterprise data and analytics systems
  • 3+ years of experience using and developing data systems with AWS and Microsoft Azure cloud data products such as AWS EMR, AWS Glue, Azure Dataverse, Azure Data Factory, and Power Apps
  • Experience with distributed data or computing tools, including Apache Spark, Apache NiFi, AirFlow, Databricks, Snowflake, Redshift, or BigQuery
  • Experience with federal information system policies, including NIST 800.53 and FISMA, data security, access controls, and data protection techniques
  • Experience creating and improving continuous automation across multiple technical stacks, and automating CD/CD pipelines with tools such as Jenkins or GitHub
  • Experience with NoSQL database such as Elasticsearch, Solr, MongoDB, or Cosmo DB
  • Experience with AI or ML pipelines and processes
  • TS/SCI clearance with a polygraph
  • Master’s degree

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.clearancejobs.com
Prepare application

Good distractions

Loading talks and stories from around this role…