With regards to your ego and the ego of your brother, everything about it is self inflicted and separate. What is in your ego is not in your brother's ego. They are two separate, private worlds. They do not connect or join or communicate or share.
Everything happening within your own ego is not happening because of or in connection with or caused by what's happening in someone else's ego. It's all happening entirely independently.
Therefore, where the ego is concerned, you need to be completely responsible for the self-contained world that your ego lives in, which is a closed world, closed to your brother. Everything about it, all of the ego experiences, feelings, reactions, perceptions, are all entirely within yourself and are yours. Own them.
You need to disconnect your ego from the egos of other people. You need to realize that two egos do not communicate. You need to realize that what another person's ego is doing (anything unloving) is not in any way shape or form a cause of anything happening in your own ego. And vice versa. You are not doing anything to their ego and their ego is not doing anything to you. Egos are separate. Egos are individuals.
However, there is something that you do share with your brother. The only thing you can share with your brother, is sharing itself. Sharing means love, joining, communication, openness, equality, freedom, truth. These things, you DO share with your brother. These things, happen to both of you at the same time. These things are mutual, shared interests. These things connect you to your brother and join you together.
So be clear about this. The parts of your experience that are ego, you need to become very clear that these are SEPARATE from your brother and have nothing to do with him. They are your own private hallucinatory world. Nothing goes outside of this world. Ideas leave not their source. Your brother's ego ideas do not leave your brother either. Neither of you causes anything in each other through the ego. Your egos are completely separate and disconnected. All they can do is make noises and postulate before each other, but it is up to each person to decide whether to use their ego or Holy Spirit in perceiving the activities of another.
If it's ego, its yours. If it's love, it's shared. Never do egos really communicate and never do egos really cause things to happen to each other. The idea of attack is entirely an illusion because attack is withdrawal into a private world. Nothing any ego says is ever about you. Nothing your ego says is ever about anyone else.
Only in the holy relationship is there any real sharing or real communication or real relationship because it is a relationship based in reality. Ego relationships are not relationships at all.