Why can some of us handle having our reality being shattered by drugs and others can't handle it?

For example a K hole. For some of us, it is a special experience that is sought after. For others, the idea is grim and there's nothing scarier than the thought of being in a K hole.

Why can some of us let go and surrender control to the high and others cannot let go and try to wrestle and fight for control?