Image of the day

Captured by
RICHARD COFER

Lunar Occultation of Jupiter (Egress)

My Account

New to Astromart?

Register an account...

Need Help?

Processing workflow

Started by gregbradley, 04/03/2006 08:21PM
Posted 04/03/2006 08:21PM | Edited 04/03/2006 08:23PM Opening Post
Can some of the more experienced CCD imagers let me know what their general image work flow looks like? Also how they save their files etc.

A few things have become obvious when handling lots of exposures using CCDs. One is the number of files and the number of new files created to handle the aligned files etc etc. The need to keep a log of what you took, how long, what temp, what colour, what binning was used.

It seems it goes something like this:

0. Create a library of dakrs for both 1 x 1 binning and 2 x 2 binning at the temperatures you will be imaging at. Take 3-5 darks and median combine the results to create a master dark and label it carefully and all darks under a master file of "Darks 1 x 1 binning" or "Darks 2x 2 binning".

Take a flat by exposing the telescope at dawn or dusk skies away from the sun at a uniformly lit part of the sky for long enough for the average pixel value to be arund 30,000. Use the clear filter.

1.Take exposures and make sure you have autosave on and the file you want the images to be saved carefully labelled with object name, colour of the image, exposure time, binning, temperature. Right here there is a problem as CCDSoft only records the colour and no other data if you do a colour run. Does add the temp, exposure length or binning (or can it be made to do that?). So I have started to label the files from a colour run like this: M20,L30 1x1 R15 G7.5 B15 2x2 -20C. each file gets that label and CCDSOft will put the colour at the end of each file as well.

2.Align the entire folder of images.

Again here is another problem. The common practice of luminance at 1 x1 binning and colour at 2x2 binning makes it so CCDSoft sometimes will align 1 x 1 and 2x2 and other times it will not (I think if they have been processed in any way it does not seem to want to do it). Now that means I have to resize the 1 x 1 images which seems to be another unnecessary step.

3. Dark subtract each image and then process them for background and brighten/contrast using CCDSoft. If you took a flat then divide the resulting image by the flat at this point.

Then save to each LRGB separate file for later combining of multiple individual colour shots. I also have been doing repair for cold and hot pixels, Hard to notice the difference but perhaps that shows up later.

4. Combine the several sub-exposures for each individual LRGB or Halpha and save.

5. Open these resulting combined images for LRGB and do a colour combine using CCDSoft and play with the colour balance so it looks OK. I have found in my limited expereience so far that CCDSoft does not do such a great job at this. Now it could be my images for RGB are not at the ideal exposure length but I have been advised for an SBig 2000XM it is R 1 G.5 B1
as a ratio and Luminance from seeing lots of images seems to be 2 - 4 times the length of the longest colour image.

Perhaps Photoshop CS2 would be better for the colour combine as it has layer technology. Comments here?

6. Now you transfer the image as a Tiff file to you image processing software for colour balance, noise reduction, curves etc etc.

Does that sounds about right?

The labelling and creation of new files to save processed files at different steps needs to be standardised for me so it reduces confusion and time in processing. Not remembering 100% what the exposure lengths were after the fact means you could subtract the wrong dark.

Also is there any freeware for an imaging log to record this for referral to afterwards when processing the images. I see sometimes people reprocess images rom several years earlier so that becomes an even more vital step to do.

Greg.
Posted 04/04/2006 04:09PM #1
Greg,
I'm not exactly the most experienced person in the group, but since I, too, spent way too much time figuring a filing and naming system I thought I'd share mine. I don't use CCDSoft, but rather AstroArt3. But I'm sure this will apply. Also, the best tool I have found for logging is a good old fashioned spiral notebook.
Here goes:
For each sequence I shoot I label the file with some simple, quick to identify information. If I were shooting M51 tonight, here is what a file might read: M51a_L_20060404_
That's M51, the "a" is for the first sequence (then b, c, etc.), L is for Luminance and then the date. The final underscore will be followed by a file number for each shot automatically supplied by AA3 in autosave mode. These all get saved to my hard drive. The next morning I will put into a folder, then subfolder for L, R, G, B, darks and flats I've shot that night. I then create an entire duplicate folder called M51_20060404_Workfolder. I use that folder for all my post processing, storing away the original for safe keeping. In Excel, using the Object name in one field and the date as YearMonthDate in another lets me call up the data either as an alphabetized object list or as a date order list. I find this very useful
As I said earlier, I also keep a written journal of all my photo and observing sessions. In this I'll record temp. conditions, angle of scope, location of object in sky, time, etc., along with number of integrations, time of exposures, etc. I write this on one line per sequence forming a column in the notebook. This is all transferred to an Excel chart the next day (when I'm not lazy). I keep a separate Excel chart for myh finished images with a naming system (eg: M51-001_LRGB_100+20+20+20_Date). On the second processed images chart I'll note the file name of the original raw images. On that first chart I'll also now list the finished image number.
I know this all sounds complicated, but I have been able to go back and find anything this way, and not have overly long and complicated file names. I have all my original raw images backed up to numbered CDs which I also note on the Excel chart of raw images.
As far as postprocessed file naming, I just keep adding steps to the name as I "save as" each step, eg: M51_DATEOFCAPTURE_30x30x_AvgcombineAA3_DDPAA3_HighPassAA3_CurvesPS_croppedAA3 etc. I'll then log all of that information on my processed image chart and finally rename the file more simply as stated above, eg: M51-001_LRGB_30+10+10+10_date.
Sorry for this rather long-winded reply, but I do hope a bit of all this might help.
Regards,
Larry
Posted 04/05/2006 01:23PM #2
Hi Greg,

I echo your comments re CCDSoft. I find that it does not do a particularly good job at colour combining. I generally just do as you do and then go to Photoshop for more processing.

Concerning file names, I initially save everything according to the date, so a typical folder would be 4apr06. As soon as the night is finished, I copy the folder onto 2 CD's, so that I have 2 backups. (Having lost both hard drives and CD's I learnt this the hard way!) For the colour images, I save them with suffixs such as r, c, etc, to show which filter was used.

I also use a notebook to record all of the details of each image. I use 10 columns to record things such as date, location, scope, object, filename, etc. Keeping good records is invaluable, especailly if you ever want to go back and find something from past sessions.

In processing, I create new folders such as "reduced" for dark subtracted and flat fielded images, and "aligned" for the aligned images. When I combine the images, I again add a suffix to indicate how I combined them and to show which colour they are.

Hope this helps.

Regards,

Maurice

* Teach a man to fish and you feed him for a day.
* Teach a man to use the internet and he won't bother you for weeks.