Understanding the
Conversation Design Process
6. Testing, Development, Deployment
QA Test Scripts must have Signoff Approval from both Design and NL, before being conducted
This ensures that QA has a thorough understanding of the design, before beginning testing
Each channel (e.g., Voice/IVR, Chatbot, etc.) must be tested in that channel — do not attempt to “simulate”.
Shortens necessary testing cycles, produces more reliable test results
Have a formal, defined, standardized, published process for logging, reviewing, and closing design defects
Include standards of what does and doesn’t constitute a “defect”
E.g, “I don’t think it should work that way…” is not a defect; “The design contains an infinite loop…” is a defect.
Some areas may need to be “stubbed out” if they link to unfinished design sections
Triage and rank defects
Classify as “Defect”, “Change Request (which carries an additional charge to the client), “Future Feature”
Assign each defect a Severity and Priority
Unless something in the design actually causes imminent risk of loss of life or limb, there is no such thing as a “Conversation Design emergency”!
“Severity” and “Priority” are not interchangeable
S1: Prevents correct operation < — > S4: Cosmetic / Aesthetic
P1: Must fix in next iteration < — > P4: Defer
Assign S & P levels during Design or NL reviews
Exit Criteria for this phase:
Successful UAT
Meets all UAT criteria, with no scope creep
UAT signoff from client