Data Engineer
Comresource, Inc.
United States
29 days ago
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Apply on www.thejobnetwork.com
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
7 years minimum
Working hours
Regular working hours
Job source
Tech stack
Java (Programming Language)
Airflow
Amazon Web Services
Amazon S3
Automation of Tests
Cloud Computing
Static Program Analysis
Software Quality
Code Review
Information Systems
Computer Engineering
Continuous Integration
+34 more
Relational Databases
Database Design
Disaster Recovery
Github
Python (Programming Language)
PostgreSQL
Enterprise Messaging Systems
Query Optimization
Secure Coding
Software Deployment
Software Engineering
Software Systems
SQL Databases
Systems Integration
TypeScript
File Transfer Protocol (FTP)
Load Balancing
Cloud Platform System
Data Ingestion
System Availability
Database Optimization
Technical Debt
Concourse
Kubernetes
Information Technology
Transport Protocols
Non-relational Database
Data Management
Functional Programming
Restful APIs
Amazon Simple Queue Service (SQS)
Terraform
Programming Languages
Microservices
Job description
Software Development
- Implement high-quality software features and components for complex software solutions, including the responsible use of agentic coding tools to enhance productivity, maintainability, and software quality.
- Lead sizing and complexity evaluation discussions for initiatives.
- Troubleshoot complex software, application, and performance issues through analysis, testing, benchmarking, and root-cause investigation.
- Guide and mentor peers in engineering best practices, including automated testing, code reviews, documentation, and secure coding standards.
Testing & Quality Assurance
- Follow and implement test practices covering all layers of the application, including unit, system, end-to-end, security, performance, regression, and automation testing.
- Implement QA processes such as code review and static analysis.
- Coach junior team members on testing techniques including TDD, BDD, and testing for positive and negative scenarios.
Data Management
- Design and implement scalable data ingestion and processing solutions supporting analytical and operational workloads.
- Apply data modeling, schema design, query optimization, and database performance tuning techniques for relational database systems.
- Design solutions that address data quality, idempotency, late-arriving data, scalability, and maintainability requirements.
Infrastructure & Integrations
- Design and support cloud-native solutions leveraging AWS technologies including MWAA (Apache Airflow), Glue, Lambda, SQS, S3, EKS (Kubernetes), Aurora PostgreSQL, and Redshift.
- Manage infrastructure using IaC, including Terraform.
- Build and maintain CI/CD pipelines using tools such as GitHub Actions or Concourse.
- Establish advanced monitoring, alerting, and logging solutions for infrastructure.
- Design systems for high availability, load balancing, and disaster recovery.
Operations
- Support production systems through deployment activities, monitoring, incident response, troubleshooting, and operational improvements.
- Collaborate with partner teams to improve platform stability, performance, and scalability.
- Utilize techniques like blue/green deployments to minimize user impact.
- Participate in on-call support processes as needed.
Security & Compliance
- Develop software with a security-first mindset using knowledge of standard security protocols, common security risks, secure coding techniques, and appropriate usage and protection of sensitive information including PHI.
- Proactively design secure code employing best practices and threat modeling.
- Implement secure integration methods and data-transfer protocols including TLS, SFTP, PGP, and equivalent technologies.
Requirements & Design
- Collaborate with technical and business stakeholders to design appropriate systems based on business needs and technical constraints.
- Write detailed technical stories and technical epics.
- Define and manage tech debt and coordinate non-functional requirements.
- Translate business needs into practical technical solutions that balance functionality, maintainability, scalability, and delivery timelines.
Requirements
- Bachelor’s degree or equivalent work experience in Computer Science, Computer Engineering, Electrical Engineering, Information Systems, or IT.
- 7+ years of software engineering experience.
- High level of experience with Python and strong experience with at least one other programming language; TypeScript and/or Java preferred.
- Experience with cloud computing platforms and infrastructure as code with heavy use of MWAA (Apache Airflow), Glue, Lambda, SQS, S3, and EKS (Kubernetes).
- High level of experience with SQL relational database management systems, including database design, data modeling, and query optimization; PostgreSQL preferred.
- Experience with non-relational databases and messaging systems.
- Experience with standard service and software deployment patterns and CI/CD systems such as GitHub Actions or Concourse.
- High level of experience developing, deploying, and supporting REST services and microservices.
- Excellent written and verbal communication skills.
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Apply on www.thejobnetwork.com
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Good distractions
Loading talks and stories from around this role…