A 'guilty conscience' is actually a bullshit ego device designed to always find you partly innocent when you are not doing anything, and wholly sinful when you step out of line. It demands that when you make mistakes you should be punished mercilessly, and that you are supposed to be ashamed, and that you are supposed to feel guilty. It says you deserve this guilt because you made a mistake. This is absolute bullshit and is not true at all. It leaves no room whatsoever for forgiveness or unconditional love.
Mistakes call for CORRECTION, not punishment, and punishment in ALL its forms does not lead to correction. It can appear to lead to correct only by inflicting additional damage and suffering which can only later yield even more mistakes in retaliation and grievance. (This is why hitting kids is nothing other than pointless abuse - an illusion of obedience arises out of fear and trauma and now the original error persists and has been joined by a second layer of self-hate - an illusion of obedience at the price of suffering and unlove, which only leads to resentment and being even more error-prone.)
Being in guilt does not make it up to anyone. Being in guilt means you are offering guilt as a gift and are giving guilt as a statement of what you are worth and what everyone is worth. It could only possibly please a sick-minded person to enter into guilt in attempt to atone for an error. And entering into guilt can only reinforce and offer sickness to that person. If you are sane, you do not want people to be guilty on your behalf, you want them to ... as the bible terms it.... repent ... i.e., stop choosing sin and choose love. If the 'error' is that they chose not to love, then the correction you should truly seek is to see them being loving - for themselves, and for you.
It would be far better when you make a mistake or fail or do something 'wrong' to offer up your innocence and love instead, to position yourself as wholly worthy of forgiveness, and to choose-again to extend love instead of punishment. That would be loving. That would be an offering of love which could truly ATONE for i.e. UNDO what you think you did wrong.
It should be in everyone's best interests that when someone does something in error, they are loved and forgiven, and in turn they are encouraged to return to love and to offer love as a way to 'make up for' the error. (This is kind of like being forced to do pushups as atonement knowing that the exercise actually helps rather than hurts.) The error is hardly corrected by admitting to guilt or demonstrating that you deserve punishment. That is an offering to a false God of hate. God holds nothing against you and only wants you to claim your innocence, unconditionally.
It is also in everyone's best interests that you choose love instead of guilt or punishment, because, literally, we are all ONE, we are joined in the mind, we SHARE an identity, and what you do to yourself you do to everyone. This goes against the ego's law that everyone is separate and that individual can suffer in isolation. If you choose guilt for yourself, you DO choose it for everyone else as well, and that is not only an additional layer of attack but also an offering for everyone to join in your suffering. Nobody wants to first be attacked and to then have the attacker turn around and attack a second time to try to make up for it! How ridiculous is that. This is also why prisons are ridiculous - when an individual suffers everyone suffers.
Mistakes call for love and forgiveness, not punishment and despair. Look at your close relationships and notice all the times that you enter into guilt as a 'worthy' response and way of 'agreeing' that you have sinned, and how you wallow in guilt in order to atone for the mistake, thinking that doing so is actually giving people what they want. If people want you to suffer in guilt, THEY are in error and do not deserve your offering.
We all mistake guilt for love because this is how the ego's thought system functions. I don't want anyone's guilt. You should not want to give anyone your guilt. It is far better that you seek true correction through the truth of Holy Spirit and return to offering love, which is truly worthwhile and valuable. You do not have to be guilty EVER AGAIN. When you make a mistake, immediately remind yourself,
"because I did this [whatever the fuck-up was], it proves I am completely innocent and I choose to love myself instead".
(This doesn't justify it being okay to be an asshole - if you're heading to that conclusion, STOP and seek correction - it's level confusion.)
Choose only love, for that is what you are.