Graphics: Visual and Interactive Computing

Comparative Visualisation: Field Trials

This page provides data that is used in our field trials study and some of our testing results. Further details of the data and tests can be found in our paper to appear in IEEE Visualization 2002 and Mr. Hualin Zhou's Thesis.

Comparison Space: M x V x E

Metrics subspace M = {M1, M2, M3, ..., M11}

Geometry subspace G = {g1, g2, g3}

Rendering subspace R = {rw, rb, rt}

Visualization subspace V = GxR = {g1-rw, g2-rw, g3-rw; g1-rb, g2-rb, g3-rb; g1-rt, g2-rt, g3-rt}

g1g2 g3
rw: rendered with white background
rb: rendered with black background
rt: rendered with an imagery background template

Experiment subspace E = {e1, e2, e3, e4, e5; e1w, e2w, e3w, e4w, e5w; e1b, e2b, e3b, e4b, e5b}

0 degree45 degree90 degree135 degree 180 degree
Original: e1 ~ e5
White Background: e1w ~ e5w
Black Background: e1b ~ e5b

Measuring Scaling Differences

Human Evaluation

Sampleg1~e5g2~e5g3~e5minmaxN:g1~e5N:g2~e5 N:g3~e5
Tim0.50.10.80.10.80.5710 1
Justine0.80.50.10.10.810.571 0
Sujata0.90.70.80.70.910 0.5
Saleem0.90.20.010.010.910.213 0
Hamid0.70.50.20.20.710.6 0
Mouwsa0.70.20.40.20.710 0.4
Hocine0.60.50.80.50.80.3330 1
Mark0.40.30.10.10.410.667 0
Ann0.80.20.40.20.810 0.333
David0.70.30.50.30.710 0.5
Andrew0.40.20.40.20.410 1
Dave0.60.40.30.30.610.333 0
Mean0.6670.3420.4010.2420.7080.9090.199 0.394
STD0.1720.1780.2820.1920.1680.2190.272 0.416

Comparison: Mx{g1-rw, g2-rw, g3-rw}x{e5}

  Big Middle Small correl STD
Human 1.00 0.00 0.28    
M1:MSE 0.825539 0.822017 0.820591 0.85 0.002547
M2:NMSE 1.047263 0.995392 0.937669 0.68 0.054823
M3:TM 1.09676 0.990805 0.879222 0.69 0.108781
M4:FFT-M 0.470171 0.515475 0.553164 -0.74 0.041554
M5:FFT-D 0.509034 0.567062 0.608742 -0.77 0.050076
M6:FFT-S 0.632227 0.69777 0.712506 -0.90 0.042735
M7:Fourier 0.804418 0.693458 0.759497 0.93 0.055814
M8:HVS-M 0.985642 0.949627 0.931184 0.82 0.027698
M9:HVS:D 1.278653 1.217734 1.148253 0.67 0.065247
M10:HVS-S 1.19623 1.174554 1.146209 0.64 0.025085
M11:MC 1.260213 1.335474 1.674258 -0.41 0.220557
Mean 0.919 0.905 0.925 0.225 0.063
STD 0.291 0.271 0.314 0.751 0.059

Comparison: Mx{g1-rw, g2-rw, g3-rw}x{e5w}

  Big Middle Small correl STD
Human 1.00 0.00 0.28    
M1:MSE 0.573787 0.519789 0.509874 0.92 0.034397
M2:NMSE 0.854128 0.734355 0.705181 0.90 0.078932
M3:TM 0.729535 0.539277 0.497281 0.90 0.123763
M4:FFT-M 0.452776 0.470536 0.538821 -0.44 0.045428
M5:FFT-D 0.505589 0.524377 0.580029 -0.48 0.038711
M6:FFT-S 0.601586 0.628227 0.699567 -0.50 0.050661
M7:Fourier 0.822491 0.650048 0.683576 1.00 0.091431
M8:HVS-M 0.83923 0.74733 0.73207 0.92 0.057968
M9:HVS:D 1.033029 0.886191 0.85815 0.91 0.093924
M10:HVS-S 1.027178 0.933195 0.897675 0.86 0.066915
M11:MC 0.97518 0.768023 0.764633 0.96 0.120593
Mean 0.765 0.673 0.679 0.541 0.073
STD 0.208 0.154 0.135 0.651 0.031

Comparison: Mx{g1-rb, g2-rb, g3-rb}x{e5}

  Big Middle Small correl STD
Human 1.00 0.00 0.28    
M1:MSE 0.736851 0.762623 0.774653 -0.83 0.019313
M2:NMSE 0.961538 1.015601 1.042393 -0.82 0.041187
M3:TM 0.924555 1.031446 1.086583 -0.82 0.08238
M4:FFT-M 0.475549 0.470204 0.455282 0.49 0.010504
M5:FFT-D 0.558695 0.548795 0.524398 0.51 0.017652
M6:FFT-S 0.698035 0.694772 0.675318 0.38 0.012282
M7:Fourier 0.601894 0.611228 0.731838 -0.31 0.072479
M8:HVS-M 0.900205 0.939777 0.965056 -0.79 0.032687
M9:HVS:D 1.175227 1.238959 1.270785 -0.82 0.048659
M10:HVS-S 1.150379 1.18089 1.21212 -0.70 0.030871
M11:MC 0.847394 0.913149 1.198269 -0.42 0.186517
Mean 0.821 0.855 0.903 -0.376 0.050
STD 0.230 0.256 0.286 0.564 0.051

Comparison: Mx{g1-rb, g2-rb, g3-rb}x{e5b}