If you are not using the standard port 80 for http (or 443 for https) then you have to write the port number. It's the way it is designed, as browsers assume port 80/443 if you don't specify it. It's the port given to http by IANA, so it is a defined standard.
Otherwise you have to set up a proxy that do answer to the 80 port and then forwards that request to your non-standard port.