HKEY_CURRENT_USER\Software\Microsoft\Internet Explorer\Main

Change (or create) the value of the string "Window Title" to whatever you want on the titlebar of Internet Explorer.

To have no title except the title of the web pages you are browsing do not enter anything for a value.