I'm thinking of studying Buddhism. Where should I start?

I've always considered myself agnostic. But I've been lately appealed to Buddhism and its progressive approach to self-improvement, spiritually and physically. What should I do first? Which school should I follow and how do I know for sure which one is perfect for myself? Is there anything I should be aware of or careful about?