Data Engineer
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Tech stack
+41 more
Job description
We are currently seeking a Mid-Level Data Engineer. The ideal candidate believes in exploring alternatives and quickly prototyping to validate hypothetical architectures or solutions.
In this position, you will:
-
Join a backend development team to develop new features for a customer-facing application.
-
Model complex data relationships and architect database designs to support efficient queries.
-
Build serverless APIs.
-
Collaborate with a Machine Learning team to deploy models that enrich data.
-
Design, build, and implement data pipelines to track data provenance.
-
Contribute to the development of custom data ingest capabilities and the integration of customer and open-source code to address complex problems using cutting-edge big data / cloud technology.
-
Design and implement core architecture and capabilities for software from prototype to operational applications.
-
Apply experience working within an Agile software development life cycle, including sprint planning, sprints, sprint review, etc.
Requirements
-
BA/BS Degree in Computer Science, Electrical Engineering, Mathematics, or similar.
-
At least 2-4 years of experience as a Software Engineer.
-
2+ years of Python development experience.
-
In some cases, educational requirements may be adjusted for applicable work experience. Work experience may be adjusted for highly specialized knowledge or uniquely applicable experience.
-
Experience in designing enterprise APIs and documentation.
-
Data parsing/transforming techniques to include JSON, XML, CSV formats.
-
Experience in SQL database (MySQL, Postgres).
-
Experience in distributed databases, NoSQL databases, full text-search engines (e.g. Elasticsearch, MongoDB, Solr).
-
Experience in RESTful web services.
-
Experience in Microservices architecture.
-
Experience in Object Oriented Programming (OOP) paradigms.
-
Experience in continuous testing, integration, and deployment.
-
Experience with the Linux operating system.
-
Have a solid understanding of Linux systems and proficiency in shell scripting (Shell/Bash, JavaScript, Python).
-
Experience in file manipulation tools (awk, sed, wc, find, grep, etc)
-
Experience in cloud based technologies (AWS, Azure).
-
Experience with configuration management tools (e.g. Git, Nexus, Maven).
-
Excellent oral and written communication skills.
Desired Skills:
-
AWS certifications highly desired, but not required.
-
Understanding of AGILE software development methodologies and use of standard software development tool suites. (e.g., JIRA, Confluence, Github Enterprise, etc.).
-
Experience in streaming and/or batch analytics (e.g. Kafka, Spark, Flink, Storm, MapReduce, Hadoop).
Security Clearance
- Must have the ability to obtain and maintain a US Government SECRET level security clearance.
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Good distractions
Loading talks and stories from around this roleβ¦