One of the major downsides of skilled immigration to the U.S. is that it also represents skilled emigration from other countries, many of which are struggling Third World countries that need all the smart people they can keep.