Dealing with Sellers Agent without a Buyer Agent

I found a property of interest and reached out to the sellers agent directly. I am prepared to submit an offer but I currently do not have a buyers agent representing me. Should I proceed? If not, what is the downfall / risk...? Is it advisable to work with an agent from the sellers agents office or is that a conflict of interest? Please advise.