I have to admit, Infinity and games like it do take a lot of time. I'm a self taught computer programmer, and Computer Science major(at least declared such, though doing general ed right now), and I haven't had an overabundance of time to devote to programming but that may be due to school, too.
Word of advice that everyone always tells me. School's like a job, and you have to do as well as you'd pay yourself for, and want to be paid for.