As Susan & Scot Westwater discuss in their “Pragmatic Talk” podcast (episode 4), you need to test your skill not just to validate it, but to also improve it. And since the customer determines where they go, the testing needs to be rigorous, uncontrolled, free-wheeling guerilla-style. Test it to break it – to truly test the boundaries. Use different states of emotion when asking the skill for responses. Different types of utterances, intents, language. Find out whether a truly natural language conversation will work.
The good news is that you can – and should – start testing right away. You don’t need to wait until you’ve spent the time & money on a finished product. Start testing right from the beginning.