After merchandising updates are done on the Tagalys dashboard, should the merchant publish the changes or will they get updated automatically?

The product positions are pushed to Magento and index tables are updated automatically. You should listen to the published event to dynamically clear any front-end caches for it to take effect for visitors immediately.