James Duff, 2nd Earl Fife — Scottish Earl, Baron and Minister of Parliament