Botium Box
An Introduction & Overview
Deliver the Best, Uncompromising CX Possible
Maximize
Value
Deliver Innovation
Faster
Reduce cost and/or
increase revenue for every
customer interaction
Seize new opportunities
by delivering customer
journeys at pace
Consistently
Mitigate
Risk
Remove and mitigate the
risk to delivering high
quality customer
interactions
Increase Efficiency
Drive efficiency and
deliver consistently
exceptional CX outcomes
Cyara + Botium, Together
Customer Smiles. Delivered at Scale.
Empower Every Chat
& Voice Bot to
Achieve More
Assure Contact Center
Technology
Performance
Delivering Flawless Customer Experiences
World’s leading
Conversational AI
Testing Platform
World’s leading Automated
Customer Experience
Assurance Provider
Creating More Intelligent & Productive Conversations
What Can Botium Box Do for You?
Botium Box enables procurement, implementation, automated
testing & QA, training & maintenance of chatbots
Regression Testing
Botium Box
Feature Set
Contains
NLP Testing
Security Testing
Monitoring
Performance Testing
End-to-End Testing
Using Cyara Botium Box, customers can automate up to
85% of their testing & cut testing time up to 93%.
Botium Box Features:
LANGUAGES
COMMUNITY
COMPATIBILITY
GLOBALIZATION
Botium Box speaks
every language
The Botium Box
global user
community is
400,000+ members,
and growing
Botium Box can test,
tune and train over
40+ Conversational
AI platforms, and
counting
Botium Box is used
in over 49 countries
around the world
What Users Expect
from Chatbots
How Cyara Botium Box
Delivers on User Expectations
[1] ACCURATE ANSWERS
ACCURATE ANSWERS VIA:
Well-thought conversational design to
deliver appropriate answers quickly.
Conversation flow testing, to check if appropriate answers are delivered
quickly. And, NLP testing to improve chatbot understanding.
[2] GREAT USER EXPERIENCE
GREAT USER EXPERIENCE VIA:
Service on all preferred channels and
platforms, including social messenger,
websites, mobile apps and voice apps.
End-to-end testing, to verify the end-user experience, across
browser, mobile app and device. Plus, voice and IVR testing to
understand users on voice channels.
[3] HIGHEST SECURITY
HIGHEST SECURITY VIA:
State-of-the-art security,
data privacy and GDPR compliance.
Continuous security testing based on OWASP, to keep
your chatbot secure and GDPR-compliant.
[4] FAST RESPONSE
FAST RESPONSE VIA:
Excellence now… not in 5 seconds.
And also on stressful days.
Performance testing, to ensure your chatbot is
responsive under high load.
6
Botium Box
Providing benefits throughout every stage of the chatbot development lifecycle
7
Chatbot Best Practices
Testing Virtual Agents: Best Practices
Plan for
Iterations
Apply 80/20 Rule for
Testing Utterances
Spend Time with
Exploratory Testing
Establish Continuous
Testing Mindset
A robust chatbot is
built by:
Use 80% of data
for training.
Multiple iterations,
extensive training,
comprehensive
testing, and
continuous tuning
and monitoring
Use 20%
for testing.
Automated
regression testing to
find defects that you
know can happen…
There’s no single
testing phase when
bringing a chatbot
to life.
Testing must be part
of the team’s daily
business, just like
coding, design and
monitoring.
And also help you to
find unanticipated
defects.
How Chatbot Testing Differs from
Application Testing
Learning cloud services
Cloud service training has impact on
software tests.
Non-linear input
This specially applies to chatbots operated with
a voice interface.
Non-deterministic user interactions
No 100%-test-coverage. Make sure the tests cover
the most common situations.
No barriers for users
Chatbots have to cover all kind of unexpected user
input in a decent way.
Customer Success Story
Customer:
Vodafone NZ
Telecom Company Headquartered in Auckland, NZ
& a partner market in the Vodafone Group
Challenge:
Solution:
● IVR downtime & other undetected failures
negatively impacted CX & reputation
● Legacy monitoring technology limited next-level
DevOps automation initiatives
● Lack of visibility into when, where & why errors
were occurring, leading to inefficient responses
● Operations teams often unaware of outages until
reported by a customer
Cyara Pulse: Automated testing & monitoring,
shifted left & reduced dev time
Benefits:
● 847,94050+ automated test calls performed
● Countless hours saved by automating timeconsuming processes
● 100% of networks proactively tested & monitored
● Positive improvement in SOC performance
reputation among customers
Customer Smiles. Delivered at Scale.
Thank you!