Solution
This is caused by the text inside boolean button. The button size will resize according to the text inside the boolean button even when you already uncheck
Show Boolean Text.
In order to prevent resizing happening, empty the
On text box and
Off text box, uncheck
Lock text in center and
Show Boolean text before building executable as below.