Yes. According to
NYC Visit
all the boroughs came together to form one wonderful NYC in 1898.