The time it takes for your website to load can be very important, if a website takes more than a couple seconds to load then customers will get frustrated navigating the website and if it creeps over three seconds users will leave the site entirely. We live in a world where people expect things instantly.
This loss in conversions is magnified when visitors currently on your site tell friends and colleagues as well.