Starting a collection

Hello, I love horses and ever since I was a kid I have wanted to collect Breyer horses. I know this might be stupid of me to ask but how should I start collecting? Do I just get what I want? Do I collect in a series? Should I only get what is currently on the website or is it worth getting stuff off eBay?

Sorry about my overthinking.