|
Well, that's what it does. A third party encoder may be worth looking into, or you can roll your own. PNG is pretty easy to encode in a streaming way (the Deflate step obviously requires a buffer, but a constant-size small one). JPG of course can't exactly be encoded line-by-line, but block by block isn't any worse.
|
|
|
|
|
You can't get decent JPEG compression for images with insufficient height, the DCT step in the JPEG compression algorithm is using pixel blocks of 8 by 8 pixels. Any less will fail terribly.
Are you sure you are actually running out of memory? How many elementary images are there, and what is their size?
The reason I ask is GDI+ tends to be pretty confusing with its error messages, e.g. when Image.FromFile() says "out-of-memory" it really means "this is an image format I don't understand". See here[^].
|
|
|
|
|
@darkDercane: Yes, I would like to compress it. The problem is that I do not know how to do this chunk by chunk.
@harold aptroot: Do you by chance know of any example on how to encode (and save) a picture block-by-block?
@Luc Pattyn: It would be no problem to hand the compression algorithm blocks of 8x8 pixels, I chose to do it linewise for no real reason. Assuming that I deliver chunks of 8x8 or bigger, how can I encode these chunks into one JPG (or PNG) file?
And yes, I am pretty sure, I am really running out of memory. The filesize of each elementary image is about 10k px (e.g. 100x100), there could be sth like10 to 100k of them in the final image. I recently tested the program by saving the resulting image on hdd and got a 1.7 GB (32bpp) bmp monster image file. I do not plan to exceed the 32kpx limit of bmp though.
|
|
|
|
|
I have several small programs that scrap input and load it into a database. Since much of the code relies on external resources being ready, a lot of my code ends up being in try/catch blocks. Is there a lot of overhead associated with these? I have tried to consolidate interaction with external sites and db's so there are a minimal number.
Is there a better way to do this than having a block in each method?
Thx
Mark Jackson
|
|
|
|
|
|
IMO if a condition can be expected and tested for then it is not an exception and you shouldn't rely on exception handling.
No comment
|
|
|
|
|
Yes, but on some other hand somewhere... continually testing for a rare state wastes cycles.
|
|
|
|
|
Agreed. There is a difference between rare, unexpected conditions and common, expected conditions.
PIEBALDconsult wrote: some other hand somewhere
Did you forget where your other hand went? Or are you using someone else's hand?
No comment
|
|
|
|
|
IMO you should stay away from religious arguments.
By the time you're finished checking all the conditions, I could have the deleted the file that you're reading.
Bastard Programmer from Hell
|
|
|
|
|
This.
Writing "bullet proof" code that handles every case from day one, I've learned is a waste of your time and CPU cycles and does nothing but piss off your boss who is wondering why it is taking you so long. Write your first pass with general case error handling and add the obscure corner cases as you come across them in testing.
However, structuring your code with the intention of handling these corner cases down the road would behoove you.
What I mean by that is... well, one of the projects I'm working on is a project that my boss implemented 100%, and he is "from the street" and doesn't believe in structure and design, so there is SQL code sprinkled pretty much every where. Had he packaged all his SQL code into a single DAL, it would have been much easier to debug and expand. The project that I wrote 100% from scratch, I did exactly that... yeah, it didn't handle every corner case from day one, but as I found the cases, I only had to change 1 or 2 places.
I'm mentioning this because it sounds like you have your external access stuff sprinkled everywhere throughout the GUI .
|
|
|
|
|
Indeed, where it's appropriate, a simple check can often save time. Ultimately, as you progress, you end up building a handy set of utility methods that you can use, for instance here's a simplified version of a file create that you could use:
public static FileStream TryCreateFile(string fileToCreate)
{
string directoryName = Path.GetDirectoryName(fileToCreate);
if (!Directory.Exists(directoryName))
Directory.CreateDirectory(directoryName);
return File.Create(fileToCreate);
}
modified 23-Nov-11 15:33pm.
|
|
|
|
|
How does that save time? Delete will check for the existence of the file a second time.
Edit: Or is that just a bad example?
"If the file to be deleted does not exist, no exception is thrown."
modified 23-Nov-11 15:20pm.
|
|
|
|
|
It was actually a bad example - I'll update it with the example I was actually thinking of.
|
|
|
|
|
I'm afraid this isn't your day; you failed at improving the example.
Directory.CreateDirectory() does nothing when the folder already exists, so there is no point checking first.
|
|
|
|
|
Actually, in this particular case, there is - the IL is slightly different internally, and it saves clock cycles on the test in CreateDirectory. That's the reason it's in. The important part is actually the second part - hence the point of the example.
|
|
|
|
|
Ah. I never looked at the IL, I was assuming they were smart enough to make the test inside CreateDirectory() as efficient as the one inside Exists() .
|
|
|
|
|
Why do I feel the need to go "Helloooooo. Microsoft."?
|
|
|
|
|
I don't know. Besides, I prefer How questions over Why questions any day.
|
|
|
|
|
Wouldn't be so handy if you'd use it to clear a folder. If you recently fetched the folders' contents, chances are that the files still exist.
Bastard Programmer from Hell
|
|
|
|
|
Pete, this is good solid code (I'd expect no less from you), but in a way I can see this as a bit of a diversion from the original topic: error handling and Try/Catch.
In your code, yes, a Directory will be created, if none exists, but, what about the case it's an error ... for this particular application ... if the user is trying to save a file to a Directory that does not exist ?
And, what about the case where the Directory exists, but is read-only ?
Should code like this be "throwing" errors ? And what, if the code "throws," should be "catching them." And, as Abbott said to Costello: "Who's on first ?"
best, Bill
"... Sturgeon's revelation. It came to him that Science Fiction is indeed ninety-percent crud, but that also—Eureka!—ninety-percent of everything is crud. All things—cars, books, cheeses, hairstyles, people and pins are, to the expert and discerning eye, crud, except for the acceptable tithe which we each happen to like." early 1950's quote from Venture Sci-Fi Magazine on the origin of Sturgeon's Law, by author Theodore Sturgeon: source Oxford English Dictionary on-line "Word-of-the-Day."
|
|
|
|
|
Bill, sorry for the delay in replying. To answer your unspoken question, yes and no - the code was answering the premise that exception handling should not be relied upon when a simple check can solve the issue. So, what is the error we're coping with in this example? It's the fact that you can't write a file into a directory until that directory exists.
The other side here, is the fact as you've rightly pointed out, that this doesn't address all the cases that can be tested for. In my defence, I wrote this as a cut-down sample in the CP editor as an example only, but you are right, there are many other conditions that could be catered for. The point is really two-fold, if you create a utility API to handle the conditions that you can test for (rather than catch as an exception) then you have given yourself a real advantage when you come to write your production code. No, you won't get rid of exception handling altogether, but you won't be relying on it to cope with conditions that could easily have been tested for.
So, why do I advocate this? Well, exception handling is meant to indicate something that you couldn't reasonably predict and cope with. The mark of a good application is one that doesn't surprise users, so I'm either going to have to do lots of try/catch (and then cope with the failure before triggering the condition in the try/catch again), or I can put something in place to cope with the error before it occurs and make an intelligent decision about coping with the problem.
I hope this somewhat rambling post conveys some of what I was trying to get across.
|
|
|
|
|
mjackson11 wrote: Is there a better way to do this than having a block in each method?
Yup, you can hook an event that catches all unhandled exceptions[^]. There you can log it, without having the need for a try-catch everywhere.
Log everything you encounter, and handle those using try-catch blocks; some will be bugs, some will be exceptions that need a) user interaction (file in use, database dead), b) no user interaction. Handle what you can and log everything.
Bastard Programmer from Hell
|
|
|
|
|
That is a last best effort rather than being a general solution because the AppDomain will then exit (or application will exit at the top level.)
|
|
|
|
|
That's the idea with an unexpected exception; your application is in an unknown state, and hence, should terminate.
Bastard Programmer from Hell
|
|
|
|
|
I don't see anything in your original post that suggested it was only applicable for "...unexpected exception; your application is in an unknown state".
Most exceptions will not fall into that category. In general your suggestion is not applicable for exceptions. And nothing I see in the OPs posts suggests it is applicable to the OP.
|
|
|
|