Man you are in a tough place. Being a man it is your responsibility to keep your house going, sometimes that is easier said then done. I am a dad to 4 boys and 1 girl. the children came from 2 different marriages. We have her children, my children, and our child. They are all grown now and out of the house. If I had it all to do over again I would do it differently. I am really close with the two boys That I made time for no matter what. the rest of the children really do not speak to me. With this being said, Take what ever time you need to take to maintain your relationship with your child. He will be forever, nothing else should take the priority spot at this point.
good luck my friend. It will be a bumpy ride but it will be worth it in the long run.