Webform, load, show and work with huge amount of data

Question

0.00/5 (No votes)

See more:

Hello, i have a big problem. I must to do a webform that load a lot of information, about 3000 records.
Load is not a problem, i'm use DataList and performance querys. In the DataList i have a HTML table dynamically generated with linkbutton inside that trigger an event that process information and paint the row.
After that, i'm show information within seconds.
The problem is when i do a postback, like a linkbutton or imagebutton, after the codebehind is process the page is loading for a while.

How I can fix this?

I thought fix that generanting the HTML table with a StringBuilder and reprocess the table after changing events table.

Any idea?

Thanks in advance.

Sorry for my English.

Posted 6-Mar-13 8:32am

Lechu81

Add a Solution

2 solutions

Add a Solution

Add your solution here

Treat my content as plain text, not as HTML

Preview 0

…

Existing Members

Sign in to your account

...or Join us

Download, Vote, Comment, Publish.

Your Email
Password
Forgot your password?

Your Email
This email is in use. Do you need your password?
Optional Password

I have read and agree to the Terms of Service and Privacy Policy
Please subscribe me to the CodeProject newsletters

When answering a question please:

Read the question carefully.
Understand that English isn't everyone's first language so be lenient of bad spelling and grammar.
If a question is poorly phrased then either ask for clarification, ignore it, or edit the question and fix the problem. Insults are not welcome.
Don't tell someone to read the manual. Chances are they have and don't get it. Provide an answer or move on to the next question.

Let's work to help developers, not make them feel stupid.

This content, along with any associated source code and files, is licensed under The Code Project Open License (CPOL)

Sergey Alexandrovich Kryukov · Accepted Answer · 2013-03-06T09:19:00

Solution 1

One simple principle is that you never want to show really huge amount of data on a single page.

Moreover, your user also won't want it. You should understand that all the lifetime of a Web application lies between HTTP request and HTTP response. Even if your application creates a response in no time, the transport time along will be unacceptable for a big page, no matter how you optimize it. Traffic is traffic, you cannot get around it.

But there is more important reason why the user don't want to see all your data at once, even if everything could happen momentarily (but it won't). The user will have problem to navigate and digest too much data at once. Few hundreds lines (I intentionally don't say "records", because you can apply different way of presentation of records; and the records can be of very different sizes) would be fine, but hardly thousands. It just makes no sense.

So, overall, the picture is not that bad. You need to thoroughly think of a way of presenting data in smaller chunks. This is more design than writing code. You can think of such approaches as paging, queries, paging, and some combinations of approaches.

—SA

Posted 6-Mar-13 9:19am

Sergey Alexandrovich Kryukov

Comments

Lechu81 6-Mar-13 18:11pm

Here is a screnshot of the page:

http://s22.postimage.org/3x7097hwh/pantalla_1.jpg[^]

And here is a screenshot of the page after user selected an table item:

http://s18.postimage.org/t9n9r5bh5/pantalla_2.jpg[^]

I have a big problem, show all information in a one page, without paging.

I'll try Sharp Robin say and I'll tell you.

Thanks for all.
Regards

Sergey Alexandrovich Kryukov 6-Mar-13 18:22pm

And..? I already explained to you the general principles you can use in your design. No, your "big problem" is not showing all in big page without paging, your problem is lack if understanding what's really required. From the user standpoint, not just from yours. This is the misconception. Overcome it, or not...
—SA

Lechu81 7-Mar-13 8:57am

I forgot to indicate it is a user's request to see all the information.

Sergey Alexandrovich Kryukov 7-Mar-13 12:45pm

Do you trust your user? Did the user tried to see it all, in a prototype?
Here is one way to resolve such problems are resolved: by consulting the users. You make prototypes and try them with the users.
It's all up to you of course, but you cannot accelerate something which does not depend on you. As I say, the traffic along may take most of the time...
—SA

Lechu81 7-Mar-13 12:58pm

Yes, i showed a prototype to the user, and he want have all information in a page. The user is accustomed to using VB6 applications and is difficult change his mind.

Sergey Alexandrovich Kryukov 7-Mar-13 13:06pm

Yes, I do understand the difficulty of such situations. That's unfortunate. Anyway, I did what I could do, now it's your turn... :-)
—SA

Lechu81 7-Mar-13 13:10pm

jajaja... thank you.

Sergey Alexandrovich Kryukov 7-Mar-13 14:07pm

You are very welcome.
Good luck, call again.
—SA

Sharp Robin · Accepted Answer · 2013-03-06T10:31:00

Solution 2

Maybe you should disable ViewState for that large DataList or you should just somehow get some filtering to your page so that you don't need to load that much data, or consider implementing some infinite scrolling feature or endless scrolling or just do both(filtering and one of the fancy scrolling features).

Hope that it helps.

Posted 6-Mar-13 10:31am

Sharp Robin

Updated 6-Mar-13 10:32am

v2

Comments

Lechu81 6-Mar-13 18:11pm

Here is a screnshot of the page:

http://s22.postimage.org/3x7097hwh/pantalla_1.jpg[^]

And here is a screenshot of the page after user selected an table item:

http://s18.postimage.org/t9n9r5bh5/pantalla_2.jpg[^]

I have a big problem, show all information in a one page, without paging.

I'll try Sharp Robin say and I'll tell you.

Thanks for all.
Regards

Lechu81 7-Mar-13 8:57am

I forgot to indicate it is a user's request to see all the information.

Sharp Robin 7-Mar-13 10:53am

That is the point of the infinite scroll that the user thinks that you are showing all the data immediately to him where in fact you load data in chunks and not all in one peace.