A liberal coating of WD40 on the parts that rust when not being used will go a long way to inhibit the rust.
When I was growing up, our bikes were stored outside, even in the harsh winter. Get an older bike and let it 'patina'. That seems to be cool these days, anyway.