Me personally—I don't think it is more immoral than allowing a person to go hungry. I think the latter is definitively more immoral—and worse for the health of a civil society—than the former. Indeed, I think it is more morally important, and more righteous, to protect the many from want than to protect the few from a (usually pretty minor, in the grand scheme) loss of assets.