I didnt know where else to put it, so i hope this is ok.
I have some questions regarding camera testing with test charts. We actually did some tests yesterday (and i guess we did a lot of mistakes, since that was our first time and noone had a plan ).
We had a test room in a big rental house, so the setup was ok from the start. Two tungsten lights on both sides of the charts, I checked to light them evenly so that shouldve been fine. We white balanced a C500 so the white was right at the middle in the vectorscope (3100K), so that shouldve been fine too.
We used the following 3 test charts:
I suppose we did some mistakes in some of the tests though so I'd like to know which of our results are usable.
Cameras we tested: Nikon D3100 (Low-Budget DSLR with 1080p video), Canon 7D, Canon C500, Red One. (and for fun a GoPro Hero2 and 3, but i guess those results are unusable anyways because the charts were too small due to the fisheye)
Lenses: Cheap standard lenses for the DSLRs (18-55mm Nikon, 18-135 Canon), Arri/Zeiss High Speed 85mm T1.3 for the C500 and the One.
1. For colortesting i guess all you have to do is get the white balance right (if your scene is lit well enough), right? So we shot that chart with all of our cameras without watching the framing (shouldve done that?) AND we actually didnt look at a waveformmonitor to get the white to clip and the black to be black (that could be a problem right?)... DSLRs with some of the standard picture profiles, C500 in log mode, One delivers Raw ofcourse.
Now if I open the files, crop the image so all you see is the chart, I think i have some nice values at the vectorscope (but are the usable?). Also can I just add saturation/tweak the master gamma to make the vectorscope be easier to read or will this distort the colors? (as you can imagine its quite centered in the C500's log picture)
2. For testing the dynamic range right, you have to set the white in the middle just to clip and the black to be at the bottom of the waveform, I know that. But what can you actually tell from a 9-stop dynamic range chart when all the cameras easily capture that DR? Does it even make sence? (We set our exposure wrong on those shots, so I guess theyre unusable anyway)
3. I just wanted to use the third chart to show lineskipping in the DSLRs images (because there are some diagonal lines ofcourse), but I guess it would be better to get some bigger diagonal lines, because the images I got out of the test, I think aren't sharp enough to show line skipping.
Another thing about this chart: I guess its important to frame it to fill the whole image right? (Because you cant compare anything otherwise?)
In my results the C500 easily resolves all of the lines possible. Then we had to move the tripod because of the One's crop factor in 2K mode. So we roughly doubled the distance to the chart and then recorded a shot with the One (I guess changing the distance is a mistake for that test, even though you have the same framing?), the results are quite bad, it resolves all the lines up to 6... Then with the DSLRs we had quite different focal lengths (which could be a mistake too?), so we moved again to get the same framing. In my results the 7D shows some nice moiree (at least that result is usable I guess) and resolves the lines up to 5/6 to be distinctive diagonal lines.
The D3100 is so hard to focus that those results are unusable anyways I guess.
Ok so now what can I get out of my test shots without relying on wrong results?
1. Do you need to watch the framing when using a color chart?
2. Do you need to expose white/black to the maximum when using a color chart?
3. Can you tweak saturation/master gamma without distorting the results of a color chart shot?
4. Can you get any results out of shooting a 9-stop DR chart when your camera resolves those anyways? (Except for results like how the ISO changes your grays or something like that)
5. Do you have to watch the framing when using a resolution/multiburst chart? (I guess so)
6. Do you have to keep the same distance when using a resolution/multiburst chart?
7. Do different focal lengths make the results of a resolution/multiburst chart unusable?
8. When testing rolling shutter, if you change the distance but your framing stays the same (due to focal length and/or crop factor), does it change anything? (It shouldn't because the image on the sensor will be the same size and rolling shutter just depends on the readout time of the sensor right? Or does the increasing distance reduce rolling shutter even though your framing stays the same?)
Wow that's quite a lot, I hope someone takes the time to answer, thanks in advance.