Past 3 years I've been working 1pm-9pm instead of usual 8am-4pm at our company, no issues, I'm the only developer on the projects I work on, tasks delivered always on time, meetings with PM always afternoon, etc.
Few months ago company hierarchy changed and the new operative manager started to harass me about this with made up reasons (not working 8 hour or not working at all) and he doesn't care about the fact that my projects might be the only ones at the company that never missed a deadline. He even turned some of my colleagues against me.

So now I'm thinking about to quit this job and go freelance or find a remote job. Am I doing it right?