While in the tavern, you can use the volume controller object to reduce environment volume, but a player entering the area will cause the volume to reset for every other player.

This seems to be related to the tavern's streaming screen, which will override environment volume for all players when toggled on or off. A player joining the tavern might be re-triggering the on/off volume override event for the screen.