Columbiaville is a hamlet in the town of Stockport, Columbia County, New York, United States. The community is located along U.S. Route 9, north-northeast of Hudson. Columbiaville has a post office with ZIP code 12050, which opened on December 28, 1888.