I think a standard MP3 palyer will be fine, have been using one PC to convert my vinyl collection to digital anyway. Also if I sit on it and break it not much will be lost.
What have you got against the Apple Ipod? What are you some kind of rabid anti-corp dude?