*hugs* I am so sorry. I almost killed one of my bettas once through a dumb blunder, and there is nothing like that sort of guilt. I really hope this little guy pulls through for you, but at least he got to know a little more about life and love due to your care.
Words feel so futile. Just try to forgive yourself and give him all the kindness you can.