James Ivory, Lord Ivory — Scottish judge