The Buy Now button will be automatically hidden when Pre-Order is turned on for the product.
A known behaviour is that the Buy Now button will still appear together with the Pre-Order button when you try to preview the settings by clicking on the "Open product page".
To ensure the Buy Now button is hidden, please go to the storefront to check instead. If the Buy Now button still shows up at the storefront, please do not hesitate to contact us.