Randomly ignoring baseURL and using local path after hugo server when building site

Perhaps. But is there any harm in testing to be sure? If the publishDir is within the project directory, just use a relative path (e.g., publishDir = 'foo').