The best way to start orienting yourself, and meeting some key people at the same time, would be ideal for you!
Why not sign up for the tour? http://newburghrestoration.com/blog/2013/08/29/bus-tour-for-newcomers-to-discover-newburgh/
You should also get in touch with Tiombe of the Newburgh Professional and Business Association. http://www.newburghpba.org/
And most of all, meet and talk to business people and residents you meet along the way!