Explore recipe: Reporting on the auto assist feature of agent copilot

<div class="article-banners">
<div id="docs-wmp-link"><a href="https://support.zendesk.com/hc/en-us/articles/5411234991258-plan" target="_blank" rel="noopener noreferrer">What's my plan?</a></div>
<div class="article-banner" id="addon_copilot"><figure class="wysiwyg-table wysiwyg-table-align-left"><table><tbody><tr>
<td><strong>Add-on</strong></td>
<td>Copilot</td>
</tr></tbody></table></figure></div>
</div><div class="note attention">You must have the <a href="https://support.zendesk.com/hc/en-us/articles/5524125586330">Copilot add-on</a> to use this feature.</div><p>In this Explore recipe, you’ll learn how to create two reports that help you analyze the effectiveness of auto assist, which is part of <a href="https://support.zendesk.com/hc/en-us/articles/7908817636378">agent copilot</a>. </p><div class="p"><div class="note tip">
<span class="tiptitle">Tip:</span> To generate these results, you could also clone the Efficiency tab from the Zendesk Messaging or Zendesk Support dashboard and add a new filter to compare tickets that did or didn't use auto assist.</div></div><p>This article contains the following topics:</p><ul>
<li data-list-item-id="e33fe362108d6e8669d75f35ce0219f83"><a href="#h_01J6J6Z883JNF0S72AMY6TAEMT">What you’ll need</a></li>
<li data-list-item-id="e9e984df57c3603bc6ec300e55a9f7a36"><a href="#h_01J6J6XCHB93N9D3SFA05DG15N">Reporting on tickets where auto assist was used</a></li>
<li data-list-item-id="e3739fecc3b8ccb9ec1efdd656e5410e1"><a href="#h_01J6J6Y0EMRZD6ZM47GWQ3PN2M">Reporting on which auto assist procedure was used on a ticket</a></li>
</ul><p>Related articles:</p><ul>
<li data-list-item-id="eaa1536c0518f7f9e45b7e5145c9faec0"><a href="https://support.zendesk.com/hc/en-us/articles/8013454025114">Turning on and configuring auto assist</a></li>
<li data-list-item-id="e00fd965e81bc06855671f6deb8ac1fa9"><a href="https://support.zendesk.com/hc/en-us/articles/7051314237466">Using auto assist to help agents solve tickets</a></li>
<li data-list-item-id="e350b4ae5ed9a8d0a2b96c4cac62ad2bd"><a href="https://support.zendesk.com/hc/en-us/articles/7719560079642">Workflow recipe: Canceling and refunding a Shopify order with auto assist</a></li>
</ul><h2 id="h_01J6J6Z883JNF0S72AMY6TAEMT">What you’ll need</h2><p><strong>Skill level:</strong> Beginner</p><p><strong>Time required:</strong> 10 minutes</p><ul>
<li data-list-item-id="e414bd76d3f95002851fe3e43c17f8736">Zendesk Explore Professional or Enterprise</li>
<li data-list-item-id="e1a459ca506f19fdc20c0432a5bea6203">Editor or Admin permissions, see this article: <a href="https://support.zendesk.com/hc/en-us/articles/4408836002970">Giving users access to Explore</a>
</li>
<li data-list-item-id="e6d2ae55386a6e9ff71509b8a56c8823c">Auto assist, see this article: <a href="https://support.zendesk.com/hc/en-us/articles/8013454025114">Turning on and configuring auto assist</a>
</li>
<li data-list-item-id="ed9f04c973920644b12e0e46bb9350cb2">Messaging or email ticket data</li>
</ul><h2 id="h_01J6J6XCHB93N9D3SFA05DG15N">Reporting on tickets where auto assist was used</h2><p>This report gives you quick insight into the tickets where auto assist was used. You can add this report to a dashboard and filter by attributes such as the agents for whom you have enabled auto assist, their groups, the specific channels where you’re using auto assist to serve customers, and more.</p><h3 id="h_01J6J6XKXQFW201JA225EWHD4V">Create custom metrics to track auto assist and non-auto assist tickets</h3><p>As part of reporting on auto assist, you’ll want to be able to slice auto assist and non-auto assist tickets separately. To do so, <a href="https://support.zendesk.com/hc/en-us/articles/4408824243738">create a standard calculated metric</a> for each set of tickets:</p><ul>
<li data-list-item-id="e2823315fc8d4d16d193e307f4b904402">Number of tickets where auto assist was used:<ul>
<li data-list-item-id="ec80dbd163e46376908d9810cce8feee6">
<strong>Name:</strong> Auto assist tickets</li>
<li data-list-item-id="eb2b2678e9f97681895b93deedec2ff05">
<strong>Formula:</strong> <code>IF (INCLUDES_ANY([Ticket tags], "agent_copilot_enabled")) THEN [Ticket ID] ENDIF</code>
</li>
</ul>
</li>
<li data-list-item-id="efacc396c98eac05fd5eae46e3734ca9e">Number of tickets where auto assist was not used:<ul>
<li data-list-item-id="e8c9b076168982a898bc52a9436c9dd19">
<strong>Name:</strong> Non-auto assist tickets</li>
<li data-list-item-id="eefacbe531ec5263c0fc4a632d9f76d71">
<strong>Formula:</strong> <code>IF (NOT INCLUDES_ANY([Ticket tags], "agent_copilot_enabled")) THEN [Ticket ID] ENDIF</code>
</li>
</ul>
</li>
</ul><div class="p"><div class="note tip">
<span class="notetitle">Tip:</span> If you use Explore in another language than English, temporarily set the <strong>Language</strong> field of <a href="https://support.zendesk.com/hc/en-us/articles/4408835022490-Viewing-and-editing-your-user-profile-in-Zendesk-Support" target="_blank" rel="noopener noreferrer">your Support profile</a> to English to create that formula, and save it.</div></div><p>You can add these standard calculated metrics to any report created in the same dataset as the metrics. For a simple example report, see the instructions below.</p><h3 id="h_01J6J6XQX4BDRN82S2PHJN5F7M">Create the report</h3><ol>
<li data-list-item-id="effc5dae6862e3a6e8cd8e862ce7e44b8">In Explore, click the Reports (<img src="https://zen-marketing-documentation.s3.amazonaws.com/docs/en/Explore_query_icon.png">) icon.</li>
<li data-list-item-id="e62eff04441c890d8c3ee692c60afd8be">In the Reports library, click <strong>New report</strong>.</li>
<li data-list-item-id="e147f779d51ea0fd8b7ab44a9108d0fd4">On the <strong>Select a dataset</strong> page, select one of the following datasets depending on which type of tickets you want to report on:<ul>
<li class="wysiwyg-list-bold" data-list-item-id="efad3fbf64bd640ddceefe254ebef2122"><strong>Chat - Messaging tickets</strong></li>
<li class="wysiwyg-list-bold" data-list-item-id="e84e34aef9148bbd394d2cf73f989c684"><strong>Support - Tickets</strong></li>
</ul>
</li>
<li data-list-item-id="e0dcba21e31fc2b1f1f3dde6e8d71aee4">Click <strong>Start report</strong>. The report builder opens.</li>
<li data-list-item-id="ee1f8cc2ceeca72a0114f8ebb8cf9a2f9">In the <strong>Metrics</strong> panel, click <strong>Add</strong> and select the following calculated metrics <a href="#h_01J6J6XKXQFW201JA225EWHD4V">created above</a>:<ul>
<li class="wysiwyg-list-bold" data-list-item-id="eeb5eba92234e3a477100d8a99e51bb57"><strong>Auto assist tickets</strong></li>
<li class="wysiwyg-list-bold" data-list-item-id="eb7e5243d23f83e2de006b7f82b340985">
<p><strong>Non-auto assist tickets</strong></p>
<div class="note tip">
<span class="tiptitle">Tip:</span> If you don’t see these metrics, make sure you created them in the correct dataset.</div>
</li>
</ul>
</li>
<li data-list-item-id="ebac5bd6c7af9b658402764f68b3e4242">Click the <strong>Visualization type</strong> menu (<img src="https://zen-marketing-documentation.s3.amazonaws.com/docs/en/Explore_visualization_type.png">) and select <strong>Pie</strong>.</li>
</ol><p>Your report should look similar to the one below.</p><p><img src="https://zen-marketing-documentation.s3.amazonaws.com/docs/en/explore_agent_copilot_pie_chart.png" width="600"></p><h2 id="h_01J6J6Y0EMRZD6ZM47GWQ3PN2M">Reporting on which auto assist procedure was used on a ticket</h2><p>With a little setup, you can create reports that show the specific procedures that auto assist used to help agents solve tickets. This gives you the tools you need to dig deeper into the efficiency gains provided by auto assist.</p><h3 id="h_01J6J6Y6C644BW5YR8D8KPYVD0">Setup recommendations for reporting on procedures</h3><p>At the very least, we recommend adding procedure-specific tags during auto assist setup. If you have a little more time, we also recommend creating a procedure-specific custom field that improves the reporting experience (custom field values are more human-readable than tags).</p><p>Whichever you choose, tag or custom field, you can use this information to analyze how procedures are performing across common metrics and attributes in the <a href="https://support.zendesk.com/hc/en-us/articles/4408827693594#topic_zlf_slp_4y">Support - Tickets</a> and <a href="https://support.zendesk.com/hc/en-us/articles/4724624097818">Chat - Messaging tickets</a> datasets.</p><h4 id="h_01J6J6YBK10522MGY5FJV7W09T">Basic recommendation: Add procedure-specific tags during auto assist setup</h4><p>During auto assist setup, if you configured ticket tags to identify the specific procedure that auto assist should follow for a given issue (such as order cancellations), you can report on these tags to see which procedure auto assist used for a given ticket. For details on configuring these ticket tags, see <a href="https://support.zendesk.com/hc/en-us/articles/8013454025114-Turning-on-and-configuring-auto-assist#:~:text=enter%20agent_copilot_enabled.-,(Optional)%20Add%20another%20tag%20to%20identify%20which%20procedure%20you%E2%80%99ve%20created%20for%20auto%20assist%20to%20follow%20in%20this%20situation,-(for%20example%2C">this setup step for answers</a> or <a href="https://support.zendesk.com/hc/en-us/articles/8013454025114-Turning-on-and-configuring-auto-assist#:~:text=tags%20%7C%20agent_copilot_enabled-,(Optional)%20Add%20another%20tag%20to%20identify%20which%20procedure%20you%E2%80%99ve%20created%20for%20auto%20assist%20to%20follow%20in%20this%20situation,-(for%20example%2C%20copilot_order_cancellation">this setup step for triggers</a>.</p><p>This information, in combination with other Explore metrics and attributes, can help you analyze which issues auto assist is most successful in helping agents resolve, as well as troubleshooting issues where auto assist is following procedures you didn’t expect.</p><p>When reporting with tags in Explore, there are some considerations to keep in mind to ensure your reports are as useful as possible. If you haven’t worked with them in Explore before, see <a href="https://support.zendesk.com/hc/en-us/articles/4408838151450">Reporting with tags</a> first.</p><h4 id="h_01J6J6YE9AAHSQXCZ2CQ39CP8K">Advanced recommendation: Create a procedure-specific custom ticket field</h4><p>You can also <a href="https://support.zendesk.com/hc/en-us/articles/4408883152794#topic_ubz_ynk_xj">create and configure a custom drop-down ticket field</a> to indicate which auto assist procedure was used on a ticket.</p><p>For example, the image below shows a custom drop-down field with several field values tied to specific tags. Each pair of values and tags indicates which procedure auto assist will follow for a customer request.</p><p><img src="https://zen-marketing-documentation.s3.amazonaws.com/docs/en/explore_agent_copilot_custom_field.png" width="500"></p><p>So in this example, if a customer requested help buying a car, the <strong>car_buying</strong> tag would be added to the ticket, either <a href="https://support.zendesk.com/hc/en-us/articles/7051314237466#topic_hsm_rsh_4cc">via the conversation bot Transfer step</a> or <a href="https://support.zendesk.com/hc/en-us/articles/7051314237466#topic_ok5_ssh_4cc">via a ticket trigger setup</a> that an admin had previously performed. This tag would then in turn set the value of the drop-down field to <strong>Car Buying Inquiry</strong>.</p><p>When you specify the tags in your custom drop-down field, make sure they match the procedure-specific tags you used during auto assist setup. Also, remember to add any new procedures to the ticket field as you create them over time.</p><p>This drop-down field doesn’t have to be added to your ticket forms unless you want your agents to be able to see its value. Hidden dropdown fields will still sync to Explore.</p><p>When you report on auto assist in Explore, this field makes it easier to visualize, break down, and filter the procedures used on your auto assist tickets.</p><p>As with tags, when reporting with custom fields in Explore, there are some considerations to keep in mind to ensure your reports are as useful as possible. If you haven’t worked with them in Explore before, see <a href="https://support.zendesk.com/hc/en-us/articles/4408824384538">Reporting with custom fields</a>.</p><h3 id="h_01J6J6YNCE3HMKWN58PEVJCDYW">Create the report</h3><ol>
<li data-list-item-id="e63bfd1d039c7ccdf280095df925cef3d">In Explore, click the Reports (<img src="https://zen-marketing-documentation.s3.amazonaws.com/docs/en/Explore_query_icon.png">) icon.</li>
<li data-list-item-id="eaae9fd559a6ffeb461f1335edfc8a6c6">In the Reports library, click <strong>New report</strong>.</li>
<li data-list-item-id="ef65ec1be2807137cfd5a846643ff74f3">On the <strong>Select a dataset</strong> page, select one of the following datasets depending on which type of tickets you want to report on:<ul>
<li class="wysiwyg-list-bold" data-list-item-id="ea878f67ade2206a15c739fe72cd23586"><strong>Chat - Messaging tickets</strong></li>
<li data-list-item-id="e7125477aad4df6f808a5009563b017d4">
<p><strong>Support - Tickets</strong><br> </p>
<div class="note">
<span class="notetitle">Note:</span> For tickets where auto assist mode is used via messaging, any replies accepted and sent via auto assist do not appear in the Messaging tickets dataset, as bot replies are excluded from this dataset. This means, for those tickets, metrics such as number of agent replies and first reply time will not align with when the autopilot was used to respond to the end user. However, you can still use this dataset to report on non-agent-centric metrics, such as resolution time.</div>
</li>
</ul>
</li>
<li data-list-item-id="e04d6e2cfc318163930047bf65d7b348c">Click <strong>Start report</strong>. The report builder opens.</li>
<li data-list-item-id="eae451591028a81ddb6889854a108b3b4">
<p>In the <strong>Metrics</strong> panel, click <strong>Add</strong> and select the <strong>Auto assist tickets</strong> calculated metric <a href="#h_01J6J6XKXQFW201JA225EWHD4V">created above</a>.</p>
<div class="note tip">
<span class="tiptitle">Tip:</span> If you don’t see this metric, make sure you created it in the correct dataset.</div>
</li>
<li data-list-item-id="eac9c36a7d628934c319260c06259cb79">In the <strong>Columns</strong> panel, click add and select the <strong>Auto assist procedure</strong> custom field <a href="#h_01J6J6XKXQFW201JA225EWHD4V">created above</a>.</li>
<li data-list-item-id="e9bb1af2eb897f9c7ede0ad53a9923811">Click the <strong>Visualization</strong> type menu (<img src="https://zen-marketing-documentation.s3.amazonaws.com/docs/en/Explore_visualization_type.png">) and select <strong>Pie</strong>.</li>
</ol><p>Your report should look similar to the one below. Note that the report includes tickets with an <strong>Auto assist procedure</strong> value of NULL (in other words, tickets where auto assist was used but no specific procedure value was captured).</p><p><img src="https://zen-marketing-documentation.s3.amazonaws.com/docs/en/explore_agent_copilot_pie_2.png" width="600"></p><div class="note tip">
<span class="tiptitle">Tip:</span> Additionally, consider cloning the Efficiency tab of the prebuilt <a href="https://support.zendesk.com/hc/en-us/articles/4724610509082#topic_a1k_gmb_y5b">Zendesk Messaging dashboard</a> or <a href="https://support.zendesk.com/hc/en-us/articles/4408835846810#topic_zd3_ybj_z3b">Zendesk Support dashboard</a> and adding the <strong>Auto assist procedure</strong> custom field as a filter to compare the efficiency of auto assist vs. non-auto assist tickets.</div><script id="docs-schema-markup" type="application/ld+json">
{
"@context": "https://schema.org",
"@type": "TechArticle",
"@id": "https://support.zendesk.com/hc/en-us/articles/7739110419610",
"url": "https://support.zendesk.com/hc/en-us/articles/7739110419610-Explore-recipe-Reporting-on-the-auto-assist-feature-of-agent-copilot",
"headline": "Explore recipe: Reporting on the auto assist feature of agent copilot",
"description": "You can create reports to analyze the usage and effectiveness of the auto assist feature in agent copilot by tracking tickets where it was used and identifying specific procedures applied on those tickets.",
"articleSection": "Copilot reporting recipes",
"datePublished": "2024-08-02T14:31:06+00:00",
"dateModified": "2025-09-06T00:05:53+00:00",
"inLanguage": "en-US",
"mainEntityOfPage": {
"@type": "WebPage",
"@id": "https://support.zendesk.com/hc/en-us/articles/7739110419610"
},
"author": {
"@type": "Organization",
"name": "Zendesk",
"@id": "https://www.zendesk.com"
},
"publisher": {
"@type": "Organization",
"name": "Zendesk",
"@id": "https://www.zendesk.com"
},
"isPartOf": {
"@type": "WebSite",
"name": "Zendesk Help",
"@id": "https://support.zendesk.com/hc/"
},
"about": {
"@type": "SoftwareApplication",
"name": "Zendesk",
"@id": "https://www.zendesk.com",
"softwareAddOn": {
"@type": "SoftwareApplication",
"name": "Explore",
"@id": "https://support.zendesk.com/hc/en-us/sections/4405298856346"
}
}
}
</script>