Unfortunately, because the crummy returns of whole life insurance are heavily front-loaded, the decision of whether or not to keep a policy is a much different than decision than whether you should have bought it in the first place. First evaluate the policy either on your own or with professional help, then if it doesn't make sense to keep, dump it in the most tax-efficient manner possible.