Can you be a First time Home Buyer twice???

I have read many articles that this can be true. I talked to a broker and I was told that for your first primary property (FHA loan) the downpayment can be 3.5% and for the second property as long as you move 100 miles away from your primary property you can get a FHA loan of 5% down payment and you don't have to get a conventional loan on your second property. Is this true?

Thanks for the help!