Native-born American men have been fleeing the workforce in droves in a decades-long trend that coincides with a rise in immigration, according to a new analysis sounding the alarm on the issue.