First, Modern art is a huge generalization.
Second, most abstract or theoretical pieces move me. Even by a narrow definition, which focuses on my response to it, it is art.
Third, nobody is forcing particular genres of modern art on you. You can can go to other galleries or museums.