Make sure you find web hosting company that has cpanel with fantastico provided. U can install Joomla using fantastico. Start by learning how to change the template. Just search in Google Joomla free template and apply the template. Then learn about modules and components. After that only try to understand Joomla structure like section,categories,etc.

I suggest use the 1.0.13 version to get as a start.