AI Assist Automation - Getting Started

Start AI Assist Automation

• Start Sahi Dashboard.
• Launch The controller.
1. First we need to create a Flowchart. If you are not familiar with creating a flowchart, see Create a Flowchart
2. If Sahi Pro AI Assist add-on is to be used with the Sahi Pro Desktop Add-on, the controller can be launched by clicking on the dropdown arrow next to Launch and then select Open Controller On the Flowcharts window.
• If Sahi Pro AI Assist add-on is to be used with the Sahi Pro Flowcharts BROWSER mode, open any browser from the Launcher Settings and open the controller (either click on the dropdown arrow next to Launch and then select Open Controller on the Flowcharts page OR press ALT key and then double click on the browser window).
• If Sahi Pro AI Assist add-on is to be used with the Sahi Pro Mobile Add-on, open the Android/iOS Viewer from Launcher Settings and open the controller (either click on the dropdown arrow next to Launch and then select Open Controller on the Flowcharts page OR press ALT key and then double click on the Android/iOS Viewer window).

Using the Controller

• On the Controller, enable AI Assist by clicking on the AI icon next to UI Element field.
• The Controller can be used to capture an image and text. User can identify, click, and choose other actions on the application.

• To capture an image:
  Select the Image Recognition from AI Assist dropdown. If needed, input the required delay (in seconds) before capturing. Press the Camera button. Select the desired area to capture the image. In Enter Image Name dialog, give the image name. You may select one of the already present folders/sub-folders from the Image Directory dropdown to save the image. The image can be saved in a new folder by providing NewFolderName/ImageName in the Image Name textfield).
  • The UI Element field in the controller will be populated with a Sahi accessor for the image.
• The Folder icon next to the Camera icon in the controller can be used to open the images directory in File Explorer.

• Using capture for text:
  Select Optical Character Recognition from the AI Assist dropdown. If needed, input required delay (in seconds) before capturing. Press the Capture button. Select the desired area to extract the text.
  • The UI Element field in the controller will be populated with a Sahi accessor for the text.
• To identify text or a saved image, select the Optical Character Recognition or Image Recognition from AI Assist dropdown and press the CTRL key, hover over the text or the image.
• UI Element Shows the Sahi accessor for that element

Add the captured Image to Flowchart

Playback

1. On the Automate dialog click on Runbutton.
2. The Run Settings dialog opens. You can select the any mode and click RUN.

View Report

1. Click on the Reports button..
2. The Report opens in a new browser tab.

AI Assist Accessor APIs