vps setup

I saw some places that have VPS hosting real cheap for unmanaged and I was thinking about going that route because I can easily add more storage and abilities to my hosting plan. I just don't know how hard it is to setup. Is setting up a VPS hard or is it not as hard as they lead you to think?