I have the same problem. I work out-of-town alot, and sometimes have to share a hotel room with someone. Usually it is with the same person, so I know his habits now.
He drinks, and sleeps like a rock when he finally goes down except for the constant beer piss breaks. Unfortunately, he goes to bed quite late, so I have to do stealth PE from about 11:00 P.M. to midnight most nights. I have a bag I keep my lube and pump in, and I slide it into the bed when he is snoring. I then proceed to pump while laying on my side facing away from his bed. You can actually jelq under the covers by bending one leg at the knee, and nothing can be seen in a dark room.
I have been doing this for over a year now off and on when I have to have a hotel roommate. My gains are convincing enough now where I’m about to say screw it, and tell him that after he goes to sleep, I’ll be taking the bathroom over for at least 1 hour, so he’d better get his pissing out of the way before he goes to sleep, or else he’ll be disturbing me during my pump time, which includes internet porn on the PC! I don’t think he wants to go there.
What it comes down to is, you either have to let your current living conditions limit your PE, or figure a way around it so you can be consistent enough to gain. That’s what I had to do. Or you can go hardcore and just do it, and maybe your brother would have to go sleep on the couch or something. That’s what I’m about to do (go hardcore).
Another thing, try taking a green tea supplement with some caffeine in it. It will help you stay sharp during the day. If you are young, 6 hours of sleep should be plenty for you to function properly. I’ve lived on 5 to 6 hours all my life, and I’m 43 now. I work 50-60 hours a week in the industrial field as well. Fast food shouldn’t wipe you out like that unless you’ve been playing video games your whole life! Suck it up, and keep your eye on the final result. That should give you the motivation to press on.
Good luck, and I hope this advice helps in some way. You can do it.