The Allies became sufficiently disturbed by German plots revolving around the Duke that President Roosevelt ordered covert surveillance of the Duke and Duchess when they visited Palm Beach, Florida, in April 1941.