To answer your question:
No, the oppression of people of color is not forgotten.
Oppression can happen in a network, with various people oppressing other people — and being oppressed! Intersectional feminism concerns itself with that: racism & sexism, and it is a good antidote to any feminism which is classist or racist.
However, women were still being oppressed historically as a group.
To understand: first, imagine a woman of color who is a slave. Then imagine a woman of color who is under Jim Crow. Then a segregated woman of color. Then a woman of color who has been redlined or whose poverty / relative lack of wealth is due to redlining. Then a woman of color who is doing everything right but is the victim of prejudice and a system which assumes all the previous things never happened.
There are white women who couldn’t own property. Couldn’t vote. Etc. I could keep going on. The numbers speak for themselves now concerning who has power in our country. It is not because women or people of color do not want power.