Ogopogo: There are lots of ways to connect/configure your network (Internet access). Lets start with the router...First, what type of router do you have? Usually, Your DSL (cable modem) connects to your router (you did say you have a router). Then your computers connect to the router to get internet access.
Usually, to configure your router, you have to open up a browser and type in the router's URL (IP address). Here is the default URL for Linksys routers: http://192.168.1.1