Heavy left hand pinky

In my left hand arpeggios I am struggling to keep a soft pinky. That first bass note is just so loud and heavy!! Any tips to help this?