The blue '+' sign appears by the names of people in Who's Online who you have not added to your Buddy List.  If there is no blue '+' sign then they are already on your Buddy List and you can chat or message with them at any time by clicking on the green balloon by their name.