Had an internship interview earlier this morning, it's a newer company just getting started says they don't have any technical aspects or employees yet so any programming interns would build the tech side up from scratch. They pay would start at $15 an hour with a guaranteed job at the end. Location is easier to get to than school.
I got an offer 20 minutes ago, I like the opportunity but I'm worried about them having college interns build the initial tech setup and work flow without supervision of a more experienced IT person

if it's your first internship, don't.
An internships goal for the intern is to get a glimpse into the work. It should have a schedule on what to learn. If not, you're just a regular laborer with low pay.

And your offer sounds like a screwover with screaming founders and bad promotion letter for you.
Get an internship at a medium to big company. Rule of thumb: the minimum size of a company should be one with a full time HR person. If there is none don't.

Life advice, never let you fool you into cheap labor by the promise of a permanent job.

@heyheni tbf, I did my gap-year internship at a hella small ISP (10 people or so. I was responsible for their datacenter after like 2 weeks - No I did not know WTF I was doing) and it turned out pretty good.