I am really sorry for the delay of this reply as it is a weekend for us here. I have checked your site and it looks like the "Access Toolbar" acl rule was disabled for the public group. Hence, it's not showing up for guests. I have enabled it and it works fine now