Which Benchmarking Tool Should I Use When Measuring the Inspection Time In Vision Builder AI?

Issue Details

I have made a Vision Builder inspection, and I want to benchmark my inspection execution time. 

I see several tools for this purpose:

• Benchmark Operation
• Inspection Interface

The mentioned above tools are showing very different values when compared to each other. Which one should I use for my case?

Solution

In reality, both tools are showing accurate data, however they measure the inspection time in different scenarios. Below you can see the use cases of each of them.

 

1. Benchmark Operation

This benchmarking tool usually shows the lowest time value of all, as it measures the pure time it takes for the inspection for a predefined amount of iterations. This tool is used for the scenarios when the inspection is not displaying resulted images and runs a specified amount of times (or one time). 

To run the Benchmark operation, do the following:

1. Navigate to Operate.
2. Click on Benchmark Inspection....
3. Specify the number of times the inspection needs to operate.
4. Click on OK.

 

2.  Inspection Interface

The default Inspection Interface represents a separate interface which allows the inspection to run continuously and display the resulting image while also benchmarking. The inspection time can show a higher value than the Benchmark Inspection option, because of the need to display every image and run continuously, along with other background operations. In the most cases, this benchmark is more realistic, as we expect to see a resulting image, especially when we run the inspection continuously for as much as we want.

To open the Inspection interface, please follow the steps below:

1. Navigate to File.
2. Select Switch to Inspection Interface.

To make a custom Inspection Interface, please follow the steps below:

1. Navigate to Tools.
2. Select Inspection Interface Configuration....
3. Choose the option Create New Custom Inspection Interface from:.
4. Select one of the offered options and start configuring the custom Inspection Interface.

Additional Information

Please also note, that the inspection time will differ even within one benchmark type, as it can be highly dependent on system resources allocated at that moment.  Running the script on other machines will also highly affect the performance and is worth to be aware of.