There's a surprising amount of money down here ... as there is in the Buffalo area. I think these are the folks that don't make big splashes with their dough. A lot of the "Chautauqua people" are supposedly from out of state -- ie, Ohio or PA -- but the BMWs and Lexus in the Wegmans parking lot all seem to have NY plates so I'm thinking the "out of towners" are really from Buffalo or NYC and are fewer in number than the locals believe them to be.
BTW, there is still also a surprisingly good market for "McMansions" out here in the boonies, even away from the lake.