AI Design Quality Checklist

<div> <div>Checkmarks</div> <div>Guiding questions</div> <div>Resources to help</div> </div> <div> <div>1.1</div> <div>Is AI necessary to uniquely solve a problem or need – ideally as identified by user research?</div> <div>AI Design Thinking Resources coming in Q2, 2024</div> </div> <div> <div>1.2</div> <div>Does the AI use case deliver value-adding and brand-differentiating experience to a significant number of users and customers?</div> <div>Product Management, Sales, Marketing</div> </div> <div> <div>1.3</div> <div>Will the delivered AI use case add enough value to offset the build and maintenance costs of the AI model?</div> <div>Product Management, Dev, DevOps</div> </div>

<div> <div>Checkmarks</div> <div>Guiding questions</div> <div>Resources to help</div> </div> <div> <div>2.1</div> <div>Did you ensure consistency of your AI user experience design with the SAP design system design patterns and guidelines for AI use cases?</div> <div> <p><a href="https%3A%2F%2Fwww.sap.com%2Fdesign-system%2Ffiori-design-web%2Ffoundations%2Fai-and-joule-design%2Foverview%2Fdesigning-intelligent-systems">Design Guidelines for Intelligent Systems</a></p> <p><a href="https%3A%2F%2Fwww.figma.com%2Ffile%2FSJh2Eb5KrBIbaK3Bo2wqtq%2FAI-UX-Pattern-Community-Explorations%3Ftype%3Ddesign%26node-id%3D4760-1808%26mode%3Ddesign%26t%3DnwmgNbFupWNnKnUj-4">SAP AI UI Starter Kit</a></p> <p><a href="https%3A%2F%2Fsap.sharepoint.com%2F%3Au%3A%2Fr%2Fsites%2F117628%2FSAPUXOrganization%2FSitePages%2FUX.aspx%3Fcsf%3D1%26web%3D1%26e%3D0nOYVx">UX Consistency Program</a></p> </div> </div> <div> <div>2.2</div> <div>Does your AI use case comply with SAP Fiori’s UI text guidelines for all conversational and generative text interactions?</div> <div><a href="https%3A%2F%2Fwww.sap.com%2Fdesign-system%2Ffiori-design-web%2Ffoundations%2Fwriting-and-wording%2Fux-writing%2Fui-text-guidelines-for-sap-fiori">SAP Design UI Text Guidelines</a></div> </div> <div> <div>2.3</div> <div>Does your AI use case design comply with SAP’s Accessibility Product Standard?</div> <div> <p><a href="https%3A%2F%2Fwiki.one.int.sap%2Fwiki%2Fpages%2Fviewpage.action%3FspaceKey%3DAcc%26title%3DSAP%2BAccessibility%2BStandard">SAP Acessibility Product Standard</a></p> <p><a href="https%3A%2F%2Fwww.sap.com%2Fwp-content%2Fuploads%2Ffiles%2Fguidelines%2FUploads%2FAccessibility%2FAccessibilityDesignToolsDocumentation.pdf">SAP Accessibility Design Tools</a></p> <p><a href="https%3A%2F%2Fsap.sharepoint.com%2Fsites%2F127599%2FSitePages%2FGuidelines-and-tools.aspx%23automated-accessibility-checks">Automated Accessibility Checks</a></p> </div> </div> <div> <div>2.4*</div> <div>Does your AI use case comply with SAP’s AI Ethics Policy and product standards?</div> <div> <p><a href="https%3A%2F%2Fwww.sap.com%2Fproducts%2Fartificial-intelligence%2Fai-ethics.html">SAP’s AI Ethics (external)</a></p> <p><a href="https%3A%2F%2Fwww.sap.com%2Fdocuments%2F2018%2F09%2F940c6047-1c7d-0010-87a3-c30de2ffd8ff.html">SAP Guiding Principles for AI</a></p> <p><a href="https%3A%2F%2Fwww.sap.com%2Fdocuments%2F2022%2F01%2Fa8431b91-117e-0010-bca6-c68f7e60039b.html">SAP Global AI Ethics Policy</a></p> <p><a href="https%3A%2F%2Fworkzone.one.int.sap%2Fsite%23workzone-home%26%2Fgroups%2FbyIKlmidd8ACgYb2l7KvG5%2Fworkpage_tabs%2Fk0Z5S64aceu7dkfnbPBwuN">SAP AI Use Case Impact Assessment Process</a> (You can find a preview of the relevant points to consider at the bottom of this article.)</p> </div> </div> <div> <div>2.5</div> <div>Did you do user research to inform and test your AI use case design?</div> <div> <p><a href="https%3A%2F%2Fsap.sharepoint.com%2Fsites%2F127599%2FResources%2FForms%2FAllItems.aspx%3Fid%3D%252Fsites%252F127599%252FResources%252FInclusive%2520Research%2520Handbook%2520by%2520SAP%2520Design%252Epdf%26parent%3D%252Fsites%252F127599%252FResources">Inclusive Research Handbook</a></p> <p><a href="https%3A%2F%2Fsap.sharepoint.com%2Fsites%2F206103%2FSitePages%2FParticipant%2520panel%2FParticipant%2520panel.aspx">SAP User Research Panel</a></p> <p><a href="https%3A%2F%2Fsap.sharepoint.com%2Fsites%2F206103%2FSitePages%2FApply%2520research%2FApply%2520research.aspx">User Research Portal (Tools, Templates, Guidance)</a></p> </div> </div> <div> <div>2.6</div> <div>Does the user experience allow users to see the organization’s ethical criteria for using AI tools and data?</div> <div></div> </div>

<div> <div>Checkmarks</div> <div>Guiding questions</div> <div>Resources to help</div> </div> <div> <div>3.1</div> <div>Does the user know where AI is being used to enhance product value and experience?</div> <div></div> </div> <div> <div>3.2</div> <div>Does the user experience enable users across diverse levels of literacy and technical expertise to easily use the AI feature?</div> <div></div> </div> <div> <div>3.3</div> <div>Do AI recommendations maintain contextual awareness of user needs and priorities?</div> <div><a href="https%3A%2F%2Fsap.sharepoint.com%2Fteams%2FUserInteractionDataManagement%2FSitePages%2FUser-Interaction-Data-Management.aspx%3Fxsdata%3DMDV8MDJ8fDc0MjMyMjBhNDZhNTQ1ODYwNDc3MDhkYzJlNDY4MTZhfDQyZjc2NzZjZjQ1NTQyM2M4MmY2ZGMyZDk5NzkxYWY3fDB8MHw2Mzg0MzYxMjc1MzM1NjUwNDd8VW5rbm93bnxWR1ZoYlhOVFpXTjFjbWwwZVZObGNuWnBZMlY4ZXlKV0lqb2lNQzR3TGpBd01EQWlMQ0pRSWpvaVYybHVNeklpTENKQlRpSTZJazkwYUdWeUlpd2lWMVFpT2pFeGZRPT18MXxMMk5vWVhSekx6RTVPbTFsWlhScGJtZGZUbGRWTkU1RVVtbE5la2wwVDFSQ2EwNURNREJPZWs1cVRGZEZNMDVFU1hST1YwMTZUbXBKZVUxSFNUQk9SRmswUUhSb2NtVmhaQzUyTWk5dFpYTnpZV2RsY3k4eE56QTRNREUxT1RVeU5UTTR8NDRiNjNmNWVkMzI4NGNmMzA0NzcwOGRjMmU0NjgxNmF8NTZlN2VjMjlhNDExNDJiMTg2ZDgwYjQzNjUzNWMwZjU%253D%26sdata%3DZmI5cHRFZ2VDK2dFYzVoNEJkTjJJM1U3Y0ZQbGtVbVc5dm1vWW5kRVdIZz0%253D%26ovuser%3D42f7676c-f455-423c-82f6-dc2d99791af7%252Cleonie.dietterle%2540sap.com%26OR%3DTeams-HL%26CT%3D1708028192734%26clickparams%3DeyJBcHBOYW1lIjoiVGVhbXMtRGVza3RvcCIsIkFwcFZlcnNpb24iOiIyOC8yNDAxMDQxNzUwNCJ9">User Interaction Data Management</a></div> </div> <div> <div>3.4</div> <div>Does the design provide controls for customizing the AI’s parameters?</div> <div></div> </div> <div> <div>3.5</div> <div> <p>Does the design allow the user to validate AI recommendations before committing to action by providing transparency on the following?</p> <ul> <li>What the AI’s recommendation is optimizing for</li> <li>Why the AI is making a recommendation</li> <li>How the AI is making a recommendation, through progressive disclosure of the model and data being used</li> <li>The call to action: Provide clear messaging on the call to action, or when no action is recommended.</li> </ul> </div> <div></div> </div> <div> <div>3.6</div> <div>Are admins and users in control of reviewing, applying, and declining the AI’s automations and recommendations?</div> <div></div> </div> <div> <div>3.7</div> <div> <p>Does the user experience capture user feedback that will be used to continuously improve AI results through</p> <ul> <li>Direct feedback patterns</li> <li>UI instrumentation</li> <li>RLHF (Reinforcement Learning through Human Feedback)</li> </ul> </div> <div><a href="https%3A%2F%2Fsap.sharepoint.com%2Fsites%2F127294">Product Experience In-Product User Feedback</a></div> </div> <div> <div>3.8</div> <div>Have you considered ways to provide in-context AI guidance to assist users in understanding what the AI is doing, including best practices for responsible use?</div> <div></div> </div> <div> <div>3.9</div> <div> <p>Have you thought about whether an admin or user should be able to</p> <ul> <li>Take over control of the system and overrule all its actions</li> <li>Turn AI enhancements off entirely</li> </ul> </div> <div></div> </div>

<div> <div>Checkmarks</div> <div>Guiding questions</div> <div>Resources to help</div> </div> <div> <div>4.1</div> <div> <p>Does the use case call to the user’s attention</p> <ul> <li>All AI generated data</li> <li>The limitations and risks of generative AI</li> </ul> </div> <div></div> </div> <div> <div>4.2</div> <div>Does the user experience make it easy to leverage output from generative AI into a workflow?</div> <div></div> </div> <div> <div>4.3</div> <div>Have you considered ways to allow users to flag bias in the AI system?</div> <div></div> </div> <div> <div>4.4</div> <div>Have you considered enabling users to capture, save, edit, and share their prompt history and embed or summarize it into exported results?</div> <div></div> </div> <div> <div>4.5</div> <div>Have you considered providing an easily searchable history of interactions with the AI to allow for easy auditing?</div> <div></div> </div>