So I splurged a couple bucks on the updated AmigaOS 3.1.4 from Hyperion. It came with both the ROMs and AmigaOS. Now, I have 3.1 installed already, and I wanted to just drop in the ROMs.
It almost worked.
It looks like they moved some libraries from the ROM out to disk/RAM in order to make space.