Would the neighbors get mad if I colored my entire driveway in chalk?

I really want to color my entire driveway using chalk. We don't share a driveway with anyone else, it's our own driveway on our own yard for our own house. But somebody said that the neighbors might get mad? I don't see why. I'm not drawing any pictures. I'm just going to color every brick on my driveway a different color, just for fun. Do you think they'll get mad?