Lenders in NJ for non-conventional mortgage

Hi everyone.

I'm under contract for buying a house in North Jersey. It is a 2-Family and I'm going to use one of the units as primary residence. I have perfect credit and can put a 20% downpayment. But the income info I can show for the past 2 years does not make me qualified for conventional loan.

So I'm looking for my best option. I prefer not to do this through a broker. Ideally if I find a small local bank who can work with me it would be great. But I'm open to any other options that would not make this deal much more expensive than it should be.

Thanks,

Edo.