HostGator is an excellent website hosting company. The package I recommend is the "Baby" option under the "Linux Hosting Service" option. It will cost you US $7.96 per month on a yearly plan and it's even cheaper for multiple-year purchases.
Please note that the sign up process is a little harder from Australia but it is well worth the extra effort.
Secure your domain name before someone else does! Click the banner above to get your domain names from GoDaddy. Note that banner prices are in US$