I mean your level of care for people is up to you, but I've always felt it quite natural to care about my family first, my friends, my neighbors, my colleagues, my city-citizens, my state citizens, my country citizens, etc, in that order.
Your neighbors are part of your community. They help ensure the safety, quality of life, and well being of your very own children.
Mine simply goes:
Family I care about
Friends
Colleagues or other people I know and like
Rest of the world
I do care that my neighbors aren’t axe murderers who will harm my family, and I will act in a way that does not harm my neighbors, but I ultimately don’t care about neighbors I don’t know any more than I care about other people I don’t know. I just happened to be born closer to them and don’t believe that coincidence means anything ethically.