How do I specify the URL that users should be redirected to, when they logout of Matomo?

By default when user logs out he is redirected to the Login form. In your config/config.ini.php you can add under the [General] category the option:

login_logout_url="http://example.org/page"

When the user logs out, he will be redirected to this URL instead.