Just following up, the issue is that I wasn’t completing the transaction successfully on the ledger (I was trying to confirm it without paging all the way to the confirm screen).
I’d still argue that the error message in the chrome-extension is incorrect, it should say something about the transaction being cancelled or rejected on the ledger device.