Hello folks, a mate pointed me towards this handy site:
http://www.specialattack.net/tf2/game-menu-generator there you can add additional servers to a list, so they show up in your game menu. It's also possible to insert other commands there, like start/stop a demo or restart server or what do I know, you'd have to manually edit the file for the other things, though - easy if you see how the file is structured.
My menu now looks like this:

By clicking on a server link you automatically connect (including password, where applicable). Thought it might come in handy?