Can I plug a 5 or 8 port switch or router into my wireless router ?

I would like to add a wired switch or router to my wireless router. My wireless router is a Linksys WRT54G. I understand on the second wired router/switch I would have to disable DHCP server but I believe that a switch doesn't offer DHCP ? Will this work and is it as easy as it sounds ? Would a switch be better that a wired router for this ?