So Long, Farewell, Auf Wiedersehen, Good-Bye!

It's the last day of summer work! This is my last post! Ahhhh! ;)

Now that I've got my COSMOS data structures, I've gone through and plotted RA-Dec, some star/galaxy classification histograms, and CMDs. I'm also adding an "epilogue" about these to my summer work summary paper.

Classification and RA-Dec

The data includes four parameters by which I can classify stars. From the ACS data, there is the class column, just as in the GOODS data, as well as their own column called mu_class. As far as I have been able to determine by my plots and n_elements(...), the mu_class assigns objects with a class of 0.85 or 0.9 and higher as a star. The redshift catalog had two additional classifier columns, the zp_best and Type. Zp_best is based on redshift data, and based on the histograms, those assigned 0 (stars), correspond to the 1's (stars) according to the Type. The interesting thing is that, when plotted, though it is obvious that my classification of class greater than 0.75 includes a few more stars than their mu_class, that mu_class has a significantly higher number of stars than even the zp/type classification. Also, the zp/type RA-Dec plots show odd wholes in the footprint, as if spheres were subtracted out; I initially supposed that this was the case, with some kind of masking, but it seems rather significant, and I've not been able to find any further documentation explain it.

CMDs

They look beautiful! At least, until you get down to the I-band; those look a little weird, but it could just be some magnitude limits acting funny-? Perhaps something to investigate further later. The G-R vs R plots are especially nice, and you can see clearly the differences in the stellar cut-offs by looking at the population getting whittled down.

Color-Color Plots

I made a couple of these really quickly, in B-V vs V-I, and you can again see the beautiful narrowing down of the stellar population between the different star-parameters.

Document, Files, etc.

I updated all of my Research document, included a few notes on my directory and file names, and copied it to data03, and eel, as well as e-mailed it to Beth and myself. I also went through and made sure to have copied all of my files in my home folder over to data03, since it's been like a week since I updated that. So, everything is all set, and now I'm kind of sad to be clearing my stuff out of the lab!

But it's been a great summer, and I'm sure I'll do more work in the future.

Au revior,
~Jennifer

Hurray, COSMOS!

Well, it's been a tiring past few days, but it's finally done! The Cosmos catalogs were giving me some trouble, and the codes to data-structure-ify them were running into a lot of trouble.

All of the nonsense with the RA and Dec columns I sorted out: it turns out the data downloading site added its own two columns of calculated sexigesimal coordinates, in addition to the catalog's RA and Dec columns. Hence the confusion. So I'm just writing these as strings and ignoring them.

I ran into a lot of other troubles with a lot of "null" entries in other columns, so I had to read them in, used a where statement to find the "null"s and replaced them all with "99.9"s. Took a lot of lines of code, and a lot of things to get the structure to co-operate and accept the columns. But, after a lot of help from Beth with de-bugging and some code acrobatics, I got it to work this evening.

There is now a catalog for the ACS COSMOS data (cosmoscat), one for the photometric data (cosmosphotcat), and a merged catalog after spherematching their RAs and Decs (cosmos).

I've also got a pretty whole-survey RA-Dec plot already done! Next to tackle: classhist, comparing my star/galaxy classification parameter to theirs, selecting out stars, cmds, color-color, etc.

Also finished my LaTeX document on GOODS, and it looked great on squid, but when i scp'ed it to eel it turned crappy and images weren't displayed correctly, and i also had some trouble e-mailing the file. This to be checked out later.

GOODS to COSMOS

So, now that I've finished up my analysis of my GOODS Stars, here are my conclusions:

The spatial distribution of the stars in the GOODS fields, both as a whole and the halo stars alone, is statistically random, showing no significant structures or streaming. To me this means one of two things, or more likely a combination thereof:
a) the stars were formed in the disk and somehow randomized and ejected into the halo
b) the stars are from Milky Way satellites, but the accretion event was so long ago that the tidal streams have settled.

I think (b) could probably account for most of them. I suppose there could be ways of telling, with metallicity or something else, which is the origin of these stars, should that be desired.

Anyway, I've written my results and conclusions up in my paper, and I'm just fine-tuning it now.

I'm moving on to (attempt to) run my process on another set of data, COSMOS- which as far as I can tell has over 1.1 million objects in it... much much larger that GOODS. Thus far it has been an unfruitful attempt, with numerous obstacles in the way of actually obtaining a readable file and getting IDL to process it. I don't know who structured their catalog, but they have made it really inaccessible by writing in the RA and Dec not in decimal form, so much of my difficulty has been getting those columns.

More work on COSMOS to be continued throughout next week.

Halo Stars

Nearly done with GOODS stars project!

K-S Test results for Halo Stars:

North:
28th mag: 0.9855 average w/ 0.24225 stdev
27th mag: 0.9988 average w/ 0.20298 stdev
26.5th mag: 0.7996 average w/ 0.3058 stdev

South:
28th mag: 0.9085 ave. w/ 0.18898 stdev
27th mag: 0.68989 ave. w/ 0.20114 stdev
26.5th mag: 0.8457 ave. w/ 0.1335 stdev

The trend towards more randomness in the 28th magnitude is still seen in the halo subset of GOODS stars, and these are not very different from those of the K-S test on the whole stellar catalog.

Given the high values, I'm comfortable gleaning from this that in the northern field the spatial distribution is random. Though the southern field has slightly lower values, they are still within the random-range, and within a standard deviation of the expected probability (based on the previous random vs random trials).

Wrapping Up

Now I'm just adding to the Results section of my Research Document, and I'll be wrapping up the GOODS stars project. Then I'll be playing with the COSMOS data and checking out its star/galaxy population and stellar spatial distribution.

K-S Test Results

Monday:
Kolmogorov-Smirnov Test
Tests for how similar two data sets are, by measuring the largest distance between the two functions. The IDL function, kstwo, works by inputting two data sets and outputting the K-S statistic "D" and the corresponding "prob". If prob is small, the tests are likely not from the same origin. I ran this test on my data and a couple sets of random data, and taking the mean and standard deviation of numerous trials for comparison. I got the kinds of results I was expecting between the random sets, but got two differing results on the GOODS stars when I included my whole star catalog versus limiting it to the 27th magnitude.

Results

GOODS-N to 27th mag vs. Random 1 (Normalized*, 1 set vs 9 sets)
d-mean: 0.19797699
d-stdev: 0.04482917
prob-mean: 0.69592268
prob-stdev: 0.2092225

*The first time I ran it, I hadn't yet normalized them, so the sets had varying total populations, and resulted in even higher values of d and lower probabilities.

GOODS-N to 28th mag vs. Random 1 (Normalized, 1 set vs 9 sets)
d-mean: 0.089285724
d-stdev: 0.055698492
prob-mean: 0.99998375
prob-stdev: 0.18113585

GOODS-S to 27th mag vs. Random 1 (Normalized, 1 set vs 9 sets)
d-mean: 0.16683391
d-stdev: 0.027475102
prob-mean: 0.84035881
probsigma: 0.12022707

GOODS-S to 28th mag vs. Random 1 (Normalized, 1 set vs 9 sets)
d-mean: 0.12184878
d-stdev: 0.042824080
prob-mean: 0.99533697
prob-stdev: 0.19727988

Random 2 vs. Random 3 (1 set vs 9 sets)
d-mean: 0.14321605
d-stdev: 0.055629589
prob-mean: 0.92319757
prob-stdev: 0.20686308

Random 2 vs. Random 3 (9 sets vs 9 sets)
d-mean: 0.12757371
d-stdev: 0.032610029
prob-mean: 0.98843256
prob-stdev: 0.070053501

Random 4 vs. Random 5 (100 sets vs 100 sets)
d-mean: 0.1610636
d-stdev: 0.046950535
prob-mean: 0.8827874
prob-stdev: 0.18292440

Conclusions

I'm more comfortable going with the statistics done on the GOODS data to the 27th magnitude, since in my work before eliminating the dimmest data points gave me a more stellar sample. This means their likenesses to randomness are lowered. The South field I think is still well within range to call "close to random" at about 84%, given the averages and standard deviations where the sets are known to be random. The North field I can't say quite as confidently, at almost 70%, but it lies at the edge of what I'd call random.

Phew!

Made it through the week!

Accomplished all of the plots

Took a huge bite out of yesterday's To-Do List. Got all of the multi-plots done in both fields, including the histograms! The only persisting problem was in the smooth plots, for some reason the contour lines only showed up on the first of the 9 plots, while all of the other labels and commands, etc. worked throughout the for-loop. This is a mystery, to be looked at later if need be.

To Do:

Read up on and implement Kolmogrov-Smirnov test
Update Research Document
...COSMOS!?

Keep to the Code

Today: Spent the majority of the day engulfed in editing and writing code.

Fixed Random Distribution

Beth pointed out to me how I had inadvertently cut off the edges of the field, so this is now fixed. For some reason I kept coming up with errors when I tried to run the code for the southern field.

Made Multi-plots!

Since the northern field worked, I proceeded with that, adding a for-loop and a multi-plot command to run numerous trials and got a 3x3 set of RA-Dec plots, and a data structure saving these trials' data.

Smooth and Significance Histograms

Next on the list was to make the smoothed RA-Dec plots, and the accompanying statistical significance histograms. When I tried to run my code on the random data though, I again ran into errors, and have isolated a problem or two, but not the solutions. I think the next thing I'll try will be to skip over the part of the code that's tripping up and see if I can get the rest of it to work or if there are further issues.

To Do:

Southern random positions, and multi-plot, data structure
Smooth RA-Dec plots for both fields, and significance histograms
-finish debugging and get smoothed RA-Dec plots
-make accompanying cumulative histograms
Kolmogrov Smirnoff Test
-to compare trends of random trials and observed data in addition to eye-balling it
Update Research Summary Document
Ditto to Alex's Nap Idea
-late night showing of Harry Potter at the iMax: movie and company were great beyond expectations, but caused slight shortage of sleep.