Since you mentioned Selenium and web client, I'll just go on and assume you were not talking about screen scraping (note that there is only one p in that word). Selenium is a tool that will do that, but obviously one with a user interface. Since you have not stated your ultimate goal, I can't really tell if you really need Selenium. Web/Page scraping can be done quite easily per code with the
Html Agility Pack[
^]. This is a free and great implementation which I have used myself before and there are also quite a few of our members who are using it.
If the pages you are using rely on JavaScript in order to have any data to be scraped, you'll probably need to use a hidden webbrowser control to fully load the page in the background and then operate on the content once it has been properly loaded.
Regards,
— Manfred