The favorites bar is still a work in progress (I hope), but there's a trick for deleting links in folders on the favorites bar. If you right-click the link (which doesn't appear to do anything) then hit the delete key, the link will be deleted. The change won't appear until you close and re-open the folder, though.
And of course you can delete links directly on the favorite bar by right-clicking and using the menu.