It isn't immediately obvious when to close the window, other clients (e.g. Element Web) has a "Got It" button in addition to the regular dialog close button.
There's still some stuff that could potentially go elsewhere but I think it's enough for now.