Only links to image are automatically changed for opening in floatbox. for youtube/vimeo videos you can use the wysiwyg-editor-plugin of floatbox plus. all other links you want to be opened in floatbox need to be prepared manually:
http://randomous.com/floatbox/instructions#multimedia