Welcome @Lisa Troise! Unfortunately, it's pretty common for our loved ones not to share our RE vision. Most with a 9-5 J.O.B. only see risks and are quick to tell horror stories from 3rd cousins uncles brothers who knew a guy once that went broke in RE.
Speaking of broke, I try not to take financial or goal advice from broke people. Having a (probably mostly) paid off duplex you have been in for 16 years is awesome! What are they gonna do when you are on here a while and buy a 16-unit? Ha. Just love them and do your thing! That's what I do. I am the first millionaire my family knows - and they don't know it! Hang in there!