Creating exact text-match AI insights rating categories

Create exact text-match AI insights to automatically evaluate messages based on specific keywords or phrases. This feature helps you maintain quality standards by scoring agent responses. You can set up to 20 categories, using conditions like "contains" or "is not" to refine your criteria. Once created, add these categories to your scorecards to start using them.




Location: Zendesk QA > Settings > AI

Exact text-match categories use autoscoring to identify specific keywords or phrases
and evaluate whether responses meet your quality standards.
Admins and account managers can create exact text-match custom rating
categories.
You can create up to 20 exact text-match AI insights per account. When you reach
this limit, you must either mark one as inactive or delete it before you can create or
activate more.
To create an exact text-match category


In Quality assurance, click your profile icon in the top-right
corner.
Click Settings ( ).
In the sidebar under Account, click AI.
Click Create AI insight.
Select the Exact text-match AI insight type.

Enter an AI insight name and Description for reviewers (optional). This is
displayed when hovering over a category name while rating a conversation.
Under If , select if you want to search only the Agent message, the
Client message or Any message.
Select the operator (default: contains) and enter one keyword or phrase per row
that you want to score automatically if they occur in messages. See Exact text-match conditions. You
can:

Click Add row for each additional keyword or phrase you want to autoscore in
this category.
Click Add condition to specify more complex keywords and phrases.
Enter '/' to add the variable {..}. You can use this dynamic content placeholder
{..} to represent any name. For example, “Hello {··}!”


Under Then score and Otherwise score, select how you want to automatically
rate the agent. For example, if the text does not include “let’s schedule a demo,” the
agent receives a negative ( ) score for this category. Otherwise, you can choose
to score them positively ( ) or use "N/A" if unsure.
Select Use as a category on a scorecard.
Click Create category.
After creating it, you must add the category to your scorecards to start using it.




Exact text-match conditions

You can add multiple rows and use the following conditions for complex findings:










Condition name
Condition type
Search query example

Do you get a thumbs up as a result for this conversation
message? "Thank you for contacting Acme Corporation, how can I help you
today?"



is
is any of

"Thank you for contacting"
"how can I help you today?"

No, because we look for entirely equal matches.


is all of

"Thank you for contacting Acme Corporation, how can I help you
today?"
"how can I help you today?"

No, although the first query matches, the second does not.


contains
contains any of

"Thank you for contacting us”
“how can I help you today?"

Yes, because the second query is part of the message.


contains all of

"Thank you for contacting”
“how can I help you today?"

Yes, because both queries are part of the message.


is not
is not any of

"Thank you for contacting us”
“we are unavailable today?"

Yes, because neither of these queries are an exact match of the
message.


is not all of

"Our business is closed"
"Please contact us tomorrow"

Yes, because none of these queries are an exact match of the
message.


does not contain
does not contain any of

"Our business is closed"
"how can I help you today?"

No, because the second query is part of the message.


does not contain all of
"Thank you for contacting” “how can I help you today?"
No, because both queries are part of the message






{
"@context": "https://schema.org",
"@type": "TechArticle",
"@id": "https://support.zendesk.com/hc/en-us/articles/9302967236890",
"url": "https://support.zendesk.com/hc/en-us/articles/9302967236890-Creating-exact-text-match-AI-insights-rating-categories",
"headline": "Creating exact text-match AI insights rating categories",
"description": "You can create up to 20 exact text-match AI insight categories to automatically score agent messages based on specific keywords or phrases and add these categories to scorecards for quality evaluation.",
"articleSection": "Using AI in Zendesk QA",
"datePublished": "2025-05-27T13:17:58+00:00",
"dateModified": "2025-12-30T10:10:02+00:00",
"inLanguage": "en-US",
"mainEntityOfPage": {
"@type": "WebPage",
"@id": "https://support.zendesk.com/hc/en-us/articles/9302967236890"
},
"author": {
"@type": "Organization",
"name": "Zendesk",
"@id": "https://www.zendesk.com"
},
"publisher": {
"@type": "Organization",
"name": "Zendesk",
"@id": "https://www.zendesk.com"
},
"isPartOf": {
"@type": "WebSite",
"name": "Zendesk Help",
"@id": "https://support.zendesk.com/hc/"
},
"about": {
"@type": "SoftwareApplication",
"name": "Zendesk",
"@id": "https://www.zendesk.com",
"softwareAddOn": {
"@type": "SoftwareApplication",
"name": "Quality Assurance",
"@id": "https://support.zendesk.com/hc/en-us/sections/6999625340058"