It does not matter if they use Ajax or something else. If the information you need is ever provided and can be seen in any other way, you can do the same in your code.
Or, maybe, you cannot, just because of one your problem: you are using try-and-error approach instead of trying to understand how things works. Such approach is utterly inefficient. I can see it by "WebBrowser" and "SHDocVw.WebBrowser" — browser components can be used, but are irrelevant to the problem. Using
WebClient
would make perfect sense, but the more universal tool is the class
System.Net.HttpWebRequest
:
http://msdn.microsoft.com/en-us/library/system.net.httpwebrequest%28v=vs.110%29.aspx[
^].
This is all you may possibly need. See also my past answers:
How to get the data from another site[
^],
get specific data from web page[
^].
[EDIT]
I found that the problem is somewhat more difficult. Please see my comment below, about possible Ajax use.
Here is some very different advice: find out and install some plug-in which works as the "HTTP spy". I, for example, use a Mozilla browser (Seamonkey, or you can use Firefox), and my plug-in is called HttpFox. Enable and start it. Then load you page. Wait until the list you need is show. Stop the plug-in. See all the requests and resources downloaded. Using HTTP requests provided, download them all. Find out in which one your data resides.
I just tried it, it shows a good hundred of downloaded items for just one page you referenced. Loot at them, find out where your data is.
Do the same thing in on step, using the code you already have. I will be a considerable shortcut in your work.
—SA