Senior Test Automation Engineer
Role details
Job location
Tech stack
Job description
ICF is seeking a Test Automation Engineer to support a large-scale modernization of a legacy enterprise application to the Appian platform. This role is critical to ensuring end-to-end quality, performance, and production readiness within an AI-augmented, agile delivery model.
This position operates as part of an embedded quality engineering function, where testing is integrated throughout the lifecycle and aligned to test-driven development (TDD) principles. The engineer will design and implement automated testing solutions, support functional validation, and ensure reliability across Appian-based workflows and automation, including Appian RPA.
Candidates must have prior hands-on experience with Appian and Appian RPA., Test Automation & Quality Engineering
- Design, implement, and maintain automated test frameworks and regression suites across UI, API, and data layers
- Develop automated test scripts for Appian applications and automation workflows, including RPA-driven processes
- Apply test-driven development (TDD) principles by defining test scenarios and acceptance criteria ahead of implementation
- Expand automation coverage based on risk, system criticality, and change impact
Functional Testing & Validation
- Support and execute functional testing across application features, workflows, and user scenarios to ensure alignment with business requirements
- Develop and maintain test cases and test scenarios that validate end-to-end functionality and user experience
- Validate acceptance criteria and business rules during sprint execution and UAT cycles
- Identify defects, document findings, and support root cause analysis and resolution in collaboration with development teams
Appian Automation & Workflow Validation
- Validate Appian-based workflows, process models, and automation (including Appian RPA bots)
- Test end-to-end business processes, including human tasks, automated steps, and exception handling
- Ensure reliability and accuracy of automated data processing, document handling, and workflow orchestration
- Validate integration points between Appian, external systems, and automation components
Integration, Data & System Validation
- Validate end-to-end workflows, including submission processing, certification, and downstream integrations
- Test integrations across enterprise services (e.g., authentication, document storage, data access layers)
- Ensure data integrity, validation logic, and transformation accuracy across structured and legacy data models
- Perform API and contract testing, including fault injection and resilience validation
Performance, Security & Production Readiness
- Design and execute performance and load tests, including validation of automated workflows under peak conditions
- Support security, accessibility (Section 508), and compliance testing
- Contribute to release readiness validation, including defect triage and remediation support
AI-Augmented Testing & Continuous Improvement
- Leverage AI-assisted tools to accelerate test case generation, test data creation, and coverage analysis
- Identify gaps in testing strategy and implement improvements
- Contribute to evolving quality engineering standards and automation practices
Agile Collaboration & Delivery Support
- Collaborate with developers, architects, and product teams to ensure alignment between requirements and validation
- Participate in backlog refinement, sprint planning, and reviews, ensuring testability of stories
- Provide clear documentation of defects, risks, and test results
Requirements
- 5+ years of experience in test automation, quality engineering, or software testing
- 2+ years of hands-on experience with Appian, including testing and validation of Appian workflows, process models, and Appian RPA (robotic process automation)
- 2+ years of experience designing and implementing automated testing frameworks
- 2+ years of experience with API testing, integration testing, and data validation
- 2+ years of hands-on experience with automation tools (e.g., Cypress, Selenium, Playwright, or similar)
- 2+ years of experience integrating automated testing into CI/CD pipelines (e.g., Jenkins, GitHub Actions)
- 2+ years of experience working in Agile/Scrum environments with embedded testing practices, * Experience applying test-driven development (TDD) in practice
- Strong understanding of software testing methodologies (functional, regression, performance, system testing)
- Proficiency with Git or other source control tools
- Experience with performance and load testing tools (e.g., JMeter, Locust, Artillery)
- Experience in federal or regulated environments
- Exposure to AI-assisted testing or AI-enabled systems
- Knowledge of Section 508 accessibility testing