He does have your goat, Robj.
You report this behavior as "It's been a month now and this seems to be a pattern with this guy." Where I live, it's a 12 hour notice before a LL can legally enter without the tenant's permission to inspect. He clearly doesn't respect you as any type of authority, you've been unable to alter his behavior except when the police are on their way, you have not one piece of evidence (i.e. police report, willing witness, notices served) to document this in court and are asking for input on an internet site. That's "got your goat," in my book. And I would have been in there the day after the porch incident with a 5 day notice. Dealing with the drama of an easily triggered violent temper and a lack of respect for others is not something to let slide. He would have received the message, loud and clear, in a business like, unemotional manner, that I'm not someone he can bully and his behavior has to change, pronto. He's got to respect me, my authority, my contractors and others around him. That notice would have been a 5 day remedy or quit, it would have detailed the lease violations, which beyond quite enjoyment, would have detailed his refusal to let your landscaper perform routine maintenance and his behavior that required the police to be called. I'd have that police report, too. Even if he turned around, it would all be in his tenant file.
I would have let him know where the limits are. A tenant is not an owner, and his rights are limited, and often they don't know where those lines are drawn. In my state, the department of consumer protection, of all departments, publishes a pamplet, "The Wisconsin Way, a Guide for Landlords and Tenants." I keep a couple on hand to enlighten these tenants. They won't believe what you say, but if it's in writing from the state, they can't argue. There would be no confusion as to who can do what, and where his behavior was out of line. The time to do that, IMO, was on the porch.
Working for the Fraternal Order of Police is no replacement for a criminal background check. I've had a few, believe it or not, and they are nothing more than telemarkers trying to get donations in return for a window sticker. They hire anyone who can pick up a phone and read a script. In my state, by statute, all court cases are on the internet and I can get every parking ticket, small claims, etc. in minutes, often while I'm on the phone with the applicant, and I do this before showing the apartment to them. When they call, and you ask for their full name, how they respond is very telling. I don't show without a full name first, just policy and a good screening tool. Good tenants understand, the problem ones don't.
Current landlords, sadly, are often a contra-reference. As often as not, they are compelled by their own needs and will praise the tenant they really want to move. Call their previous landlords that no longer have any such incentive. Much more accurate.
Your OP stated your other tenant left within a week, and she was afraid for her safety. The implication was she moved because of him, then you say she moved as she was late and you were evicting. Big difference.
IMO, you've fallen victim to the Tenant Lottery due to shortcomings in your screening. Your properties must be in better areas than mine, given that you've not seen this before. I've come to the point where I do the internet court checks on their references and their listed landlords (I expect their landlords, if they really are landlords, to show evictions where they are the plaintiff), every name that appears anywhere on the application, and a similar check with the assessors office on any address they list, checking to see if it really does exist. It takes but minutes, and can be so reveiling. Once you discover your mistake, however, you have to act, it's just what you have to do when a problem tenant does get in, and from your posts, again, IMO, you've been slow off the blocks and missed opportunities to document and support a probable eviction.
Good luck, but you're a landlord, not someone who can influence a change in someone else's mental makeup. You need to rid yourself of this tenant, and haven't been effective in just doing the things you could have done to first, prevent him from getting in, and second, to get him out.