Owner Occupied Financing on Multi Family (Primary Residence)

[Lafontant Cherilus]

Here's the situation;

1. Not too many multi families in southern NJ (where I reside) and work in Philadelphia.  (goal to get multifamily with positive cash flow after debt servicing, reserves, maintenance, taxes etc) 

2. Was thinking of getting owner occupied financing on a multi family in Northern NJ (about 90 min away) - a 4 unit, in which one of the units would be occupied by me on the weekends.

Was told that this may not be legal because I do not spend most of my days there.  My response is: what about people who travel for work during the week and are only home on the weekend?