What do I do from here?

it depends,did this happen all of a sudden? because something might of happened or he might have a problem that he hasnt told you or if this has always been happening then either talk to him and figure out away to work with it and let him know he needs to spend more time with you if he loves you he will and if not then i think its time to end it, yet you know him better than i do so if you decide something else and it seems right then do it