Web scraping C# not able to get data in page source

Question

0.00/5 (No votes)

See more:

Xpath of data displayed in website is : "//*[@id="price"]".
HTML line is : "15.25".

When try to view page source the value 15.25 is not showing.
Here is the piece of page source: -

...

<td colspan="2" style="text-align:center">
									<span id="price" style=" font-size: 1.8em;font-weight: bold;line-height: 20px;"></span>
									<span id="vxRate"></span>
								</td>

...

<script>fetchPrice();</script>
<script>fetchvRate();</script>

What I have tried:

HtmlAgility pack as well as several methodologies from internet.

Posted 22-Dec-18 16:28pm

anil_kumar_bhakta

Updated 22-Dec-18 17:36pm

Add a Solution

1 solution

Add a Solution

Add your solution here

Treat my content as plain text, not as HTML

Preview 0

…

Existing Members

Sign in to your account

...or Join us

Download, Vote, Comment, Publish.

Your Email
Password
Forgot your password?

Your Email
This email is in use. Do you need your password?
Optional Password

I have read and agree to the Terms of Service and Privacy Policy
Please subscribe me to the CodeProject newsletters

When answering a question please:

Read the question carefully.
Understand that English isn't everyone's first language so be lenient of bad spelling and grammar.
If a question is poorly phrased then either ask for clarification, ignore it, or edit the question and fix the problem. Insults are not welcome.
Don't tell someone to read the manual. Chances are they have and don't get it. Provide an answer or move on to the next question.

Let's work to help developers, not make them feel stupid.

This content, along with any associated source code and files, is licensed under The Code Project Open License (CPOL)

Dave Kreskowiak · Answer 1 · 2018-12-22T17:37:00

Solution 1

You can't get the data because the data isn't there.

First, XPath is kind of useless because HTML is NOT XML.

The HtmAgility Pack is your best bet for dealing with HTML.

You haven't supplied enough information, but it would appear that the javascript code loaded with the page is what is putting that data in place. But, since the code doesn't run when you load the page with whatever code you're using, the data doesn't exist.

Posted 22-Dec-18 17:37pm

Dave Kreskowiak

Comments

anil_kumar_bhakta 23-Dec-18 6:27am

you are right. but when we go for element inspect from browser data shown. I think this data is being loaded by the function "fetchPrice()". Here "fetchPrice()" how works i do not know.

Dave Kreskowiak 23-Dec-18 9:50am

Because in the browser, the javascript gets to run. In your code, when the page source is downloaded, it doesn't.

But then, this is all speculation because you haven't said anything at all about how you're downloading the page source.