Undercutted - Deal gone wrong

[Aaron Phillips]

So, I was talking with this seller for about a month or so now - and we exchanged texts back and forth with each other negotiating a deal on his property that he just wanted to get rid of. It was a property that he had inherited, but he already had a home of his own and didn't have no use for the house that he had inherited. 

We finally came to an agreeable price, and was supposed to meet up last Wednesday, October 11th to sign a purchase agreement. When I had arrived at the property he wasn't there so I messaged him multiple times with no response. Something was fishy. I go back home, and get a text from him that says "Sorry, I am just going to sell to one of my neighbors." I proceeded to explain how he shouldn't accept a price we negotiated on just to turn around and sell to someone else. I was livid, but I kept my composure. 

My question I bring to you guys today is since there was NO Purchase Agreement in place yet, just a verbal agreement - Can I take legal action against him for going against his word to sell? Or am I just basically out of luck? I had to drive a good distance just to meet with the guy, and take time out of my day which I could have been spending looking for other deals. 

Chalk this up to lesson learned? Or would you all do something about this as well.