If I switch to a previous version of an asset in DAM, will the asset be automatically updated in the Drupal Media Library?

No. If you select a previous version of an asset in DAM and select Set Version as Finalized, Drupal will not make any changes to the asset in the Media Library. Drupal will only detect a new asset version if it is uploaded to DAM.