I wish there was an organization that was dedicated to helping transplants get settled in the city. It’s a bit hodge podge at the moment.
Pathstone is a good place to start. They have first time home buyer classes, and can help with down payment assistance if you attend the classes and meet income requirements. (845) 569-0770
Navigating Newburgh is a monthly group meeting right now that might be the most valuable in getting advice and direction. Go through the meeting minutes and you’ll see they address things like how to get a loan and what grants are available out there, especially for those in creative fields. Resource page has good info.