I have read several articles on this and what I have most commonly seen said is that they are very similar in loading speeds. It's said that it would just come down to the content on a given site and how it is handled.
Drupal is supposed to be faster than either Wordpress or Joomla though, based on what I have read.