Condition: Naive vs Guided — both conditions, scored identically
Figures shown: every individual run's raw integer response (10 per model), naive and guided in separate tables — not accuracy

Page generated: 2026-08-16
Data (model runs) generated: 2026-04-11
Scoring inputs: ground truth cc2ed8f5, evaluate.py 845b70e9

Counting Errors per Run: Raw Responses

Every individual model run for each of the 10 counting questions. Rows are grouped by page; within each page, one row per model showing all 10 individual run responses against the ground truth. Cells are color-coded by signed error magnitude.

Cell color: correct (error 0) ±1 ±2 ±3 ±4 or more no parseable response
Q7: Archivist marks

Naive (no expert guidance)

PageModelGTr1r2r3r4r5r6r7r8r9r10
1Claude10000000000
GPT11100111100
Gemini 2.511343143113
Gemini 3.111111111111
Claude (thinking)10000000000
2Claude10000000000
GPT12222222222
Gemini 2.512222112121
Gemini 3.110000000000
Claude (thinking)100000100000
3Claude00000000000
GPT01111111111
Gemini 2.502242224244
Gemini 3.100000000000
Claude (thinking)00000000000
4Claude00000000000
GPT00000000000
Gemini 2.500000000000
Gemini 3.100000000000
Claude (thinking)00000000000
5Claude00000000000
GPT01110000000
Gemini 2.506000606660
Gemini 3.100000000000
Claude (thinking)00003000000
6Claude22202200222
GPT20000000000
Gemini 2.525112155522
Gemini 3.120000000000
Claude (thinking)22222028522
7Claude11111111111
GPT12233222232
Gemini 2.512212221122
Gemini 3.111111111111
Claude (thinking)10000000100
8Claude10000000000
GPT10000000000
Gemini 2.511111411114
Gemini 3.110000000000
Claude (thinking)10000000000
9Claude00000000000
GPT00000000000
Gemini 2.500000000000
Gemini 3.106666666666
Claude (thinking)00000000000
10Claude10000000000
GPT10000000000
Gemini 2.511111111111
Gemini 3.110000000000
Claude (thinking)10064080600
11Claude10000000000
GPT10000000000
Gemini 2.510000000000
Gemini 3.110000000000
Claude (thinking)10001110100
12Claude11111111111
GPT10000000000
Gemini 2.511111111121
Gemini 3.111110001110
Claude (thinking)11111111111
13Claude00000000000
GPT01100100022
Gemini 2.506600666606
Gemini 3.100000000000
Claude (thinking)00000000000
14Claude00000000000
GPT00000000000
Gemini 2.5018016181816016016
Gemini 3.100000000000
Claude (thinking)00000000000
15Claude00000000000
GPT00000000000
Gemini 2.505550015104
Gemini 3.100000000000
Claude (thinking)00000000000
16Claude10000000000
GPT10000000000
Gemini 2.518888888898
Gemini 3.110000000000
Claude (thinking)10000000000
17Claude15550550550
GPT10000020000
Gemini 2.511111111111
Gemini 3.111111111111
Claude (thinking)13036063536
18Claude10000000000
GPT11100000100
Gemini 2.51221212222211
Gemini 3.110000000000
Claude (thinking)10000000000
19Claude00000000000
GPT00000000000
Gemini 2.50152152152151522
Gemini 3.100000000000
Claude (thinking)00000000000
20Claude20000000000
GPT26666664466
Gemini 2.522422222244
Gemini 3.123333333333
Claude (thinking)20000000000
21Claude10000000000
GPT10000000000
Gemini 2.513532325233
Gemini 3.111111111111
Claude (thinking)10000000000
22Claude10000000000
GPT10000000000
Gemini 2.5101622020171616
Gemini 3.110000000000
Claude (thinking)10000000000
23Claude20000000000
GPT20000000000
Gemini 2.5290029012229
Gemini 3.122022202222
Claude (thinking)22204024356
24Claude00000000000
GPT00000000010
Gemini 2.500130060110613
Gemini 3.100000000000
Claude (thinking)00000000000
25Claude10000000000
GPT10000000000
Gemini 2.510000000000
Gemini 3.110000000000
Claude (thinking)10000000000
26Claude00000000000
GPT00000000000
Gemini 2.500000000000
Gemini 3.100000000000
Claude (thinking)00000000000
27Claude00000000000
GPT00000000000
Gemini 2.500000000000
Gemini 3.100000000000
Claude (thinking)005050020412
28Claude00000000000
GPT00000000000
Gemini 2.501615151616015161515
Gemini 3.100000000000
Claude (thinking)00000000000
29Claude00000000000
GPT00000000000
Gemini 2.500000000000
Gemini 3.100000000000
Claude (thinking)00000000000
30Claude00000000000
GPT00000000000
Gemini 2.500000000000
Gemini 3.100000000000
Claude (thinking)00000000000
31Claude11111111110
GPT11011111011
Gemini 2.511111111111
Gemini 3.111111111111
Claude (thinking)11110111111
32Claude21111111111
GPT23332332223
Gemini 2.525225225552
Gemini 3.122222222222
Claude (thinking)22222222222
33Claude00000000000
GPT00000000000
Gemini 2.5010997101010777
Gemini 3.100000000000
Claude (thinking)000388381008
34Claude24443444234
GPT22122122222
Gemini 2.522212221323
Gemini 3.121111111111
Claude (thinking)22222222222
35Claude11211111112
GPT11111111211
Gemini 2.511111111111
Gemini 3.111111111111
Claude (thinking)11211111111
36Claude30000000000
GPT33223232222
Gemini 2.531111111331
Gemini 3.132222222222
Claude (thinking)31121102110
37Claude42222222222
GPT42221222112
Gemini 2.544451414545
Gemini 3.144444444444
Claude (thinking)42222222222
38Claude00000000000
GPT00000000000
Gemini 2.500000000000
Gemini 3.101111111111
Claude (thinking)00000000000
39Claude11111111111
GPT10000000000
Gemini 2.511111111111
Gemini 3.111111111111
Claude (thinking)11111111111

Guided (with expert guidance)

PageModelGTr1r2r3r4r5r6r7r8r9r10
1Claude12332332232
GPT11121111112
Gemini 2.511111111111
Gemini 3.111111111111
Claude (thinking)13113010130
2Claude10020200—20
GPT10000000000
Gemini 2.512222222222
Gemini 3.110000000000
Claude (thinking)10020201222
3Claude00000000000
GPT00000000001
Gemini 2.501111111001
Gemini 3.100000000000
Claude (thinking)00000000000
4Claude00000000000
GPT00000000000
Gemini 2.500000000000
Gemini 3.100000000000
Claude (thinking)00000000000
5Claude00000000000
GPT00000000000
Gemini 2.500000000000
Gemini 3.100000000000
Claude (thinking)00000000000
6Claude21111111111
GPT20000000000
Gemini 2.522212221222
Gemini 3.120111111111
Claude (thinking)21111111111
7Claude10000000000
GPT10121222112
Gemini 2.511111111111
Gemini 3.111111111111
Claude (thinking)10010000101
8Claude10000000000
GPT10000000000
Gemini 2.510000000000
Gemini 3.110000000000
Claude (thinking)13202022022
9Claude00000000000
GPT00000000000
Gemini 2.500000000000
Gemini 3.100000000000
Claude (thinking)00000000000
10Claude10000000000
GPT10000000000
Gemini 2.511111111111
Gemini 3.110001000001
Claude (thinking)12000220002
11Claude11511111111
GPT10000000000
Gemini 2.51111111—111
Gemini 3.111100101111
Claude (thinking)11111111111
12Claude10000000000
GPT10000000000
Gemini 2.512212121222
Gemini 3.111111111111
Claude (thinking)10011011110
13Claude00000000000
GPT00000000000
Gemini 2.500000000000
Gemini 3.100000000000
Claude (thinking)00000000000
14Claude00000000000
GPT00000000000
Gemini 2.500000000000
Gemini 3.100000000000
Claude (thinking)00000000000
15Claude00000000000
GPT00000000000
Gemini 2.500000000000
Gemini 3.100000000000
Claude (thinking)00000000000
16Claude10000000000
GPT10000000000
Gemini 2.512122211222
Gemini 3.111000000000
Claude (thinking)10020200000
17Claude11112121111
GPT11100001110
Gemini 2.512221212212
Gemini 3.111111111111
Claude (thinking)11122132216
18Claude12222222222
GPT11111010101
Gemini 2.511211211211
Gemini 3.110010001001
Claude (thinking)12122222211
19Claude00000000000
GPT00000000000
Gemini 2.502121221212
Gemini 3.100000000000
Claude (thinking)01200000111
20Claude22222222222
GPT22000022000
Gemini 2.522222222222
Gemini 3.122222222222
Claude (thinking)22111212111
21Claude11111111111
GPT10000000000
Gemini 2.511111113131
Gemini 3.111111111111
Claude (thinking)11111111111
22Claude11111111111
GPT10000000000
Gemini 2.511111111111
Gemini 3.110000111000
Claude (thinking)11011101100
23Claude22222222222
GPT20000000000
Gemini 2.521111111111
Gemini 3.120000000000
Claude (thinking)23223222222
24Claude00000000000
GPT00000000000
Gemini 2.500000000010
Gemini 3.100000000000
Claude (thinking)00000000000
25Claude10000000000
GPT10000000000
Gemini 2.510000000000
Gemini 3.110000000000
Claude (thinking)10000000000
26Claude00000000000
GPT00000000000
Gemini 2.500000000000
Gemini 3.100000000000
Claude (thinking)00000000000
27Claude0000000—000
GPT00000000000
Gemini 2.501715217—2151715—
Gemini 3.100000000000
Claude (thinking)00010000000
28Claude00000000000
GPT00000000000
Gemini 2.500000000000
Gemini 3.100000000000
Claude (thinking)00000000000
29Claude00000000000
GPT00020000202
Gemini 2.500000000000
Gemini 3.100000000000
Claude (thinking)00000000000
30Claude00000—0000—
GPT00000000000
Gemini 2.500000000000
Gemini 3.100000000000
Claude (thinking)00000000000
31Claude11121212111
GPT11210112102
Gemini 2.511111111111
Gemini 3.111111111111
Claude (thinking)11111111111
32Claude21211111121
GPT22222221122
Gemini 2.522222222222
Gemini 3.122222222222
Claude (thinking)22122111121
33Claude00000000000
GPT00000000000
Gemini 2.500000000000
Gemini 3.100000000000
Claude (thinking)00000000000
34Claude22222222222
GPT22211111111
Gemini 2.522211221211
Gemini 3.121111111111
Claude (thinking)22222223222
35Claude11111111111
GPT11112222222
Gemini 2.511111111111
Gemini 3.111111111111
Claude (thinking)11111111110
36Claude33323333323
GPT33222222223
Gemini 2.535555545445
Gemini 3.133222323232
Claude (thinking)32222222231
37Claude42222222222
GPT42022022222
Gemini 2.544444444444
Gemini 3.143333344333
Claude (thinking)42232232222
38Claude00000000000
GPT00000000000
Gemini 2.500000000000
Gemini 3.100000000000
Claude (thinking)00000000000
39Claude11111111111
GPT10000001000
Gemini 2.511111111111
Gemini 3.111111111111
Claude (thinking)11111111111
Q8: Quondam count

Naive (no expert guidance)

PageModelGTr1r2r3r4r5r6r7r8r9r10
1Claude1012121212121212121212
GPT1000120120120010
Gemini 2.5104444344334
Gemini 3.11010101010101010101010
Claude (thinking)1013111013111410101411
2Claude22222222222
GPT20000000000
Gemini 2.521000110101
Gemini 3.122222222222
Claude (thinking)22222222322
3Claude11111111111
GPT10000000000
Gemini 2.510110011011
Gemini 3.111111111111
Claude (thinking)11111111111
4Claude1310101212101210101012
GPT130000000000
Gemini 2.51311111011101110101011
Gemini 3.11311111111111111111111
Claude (thinking)1314121313121213121412
5Claude710101010101010101010
GPT70000300000
Gemini 2.575444545554
Gemini 3.176666666666
Claude (thinking)778108988888
6Claude20000000000
GPT20000000000
Gemini 2.520000000000
Gemini 3.120000000000
Claude (thinking)20000000000
7Claude12222222222
GPT10000000000
Gemini 2.510000000000
Gemini 3.112222222222
Claude (thinking)11111111111
8Claude610101010101010101010
GPT60011000000
Gemini 2.563434444344
Gemini 3.166666666666
Claude (thinking)69869679996
9Claude1212121212121212121212
GPT1280066606610
Gemini 2.5121099129129101212
Gemini 3.11212121212121212121212
Claude (thinking)1217121218151315141215
10Claude55555555555
GPT50000000000
Gemini 2.555555555555
Gemini 3.155555555555
Claude (thinking)55556756665
11Claude1112121210121212121212
GPT110000000000
Gemini 2.5118988888889
Gemini 3.11111111111121111121111
Claude (thinking)1114161514141514111312
12Claude23334334333
GPT20101111011
Gemini 2.522222222222
Gemini 3.122222222222
Claude (thinking)22322222233
13Claude11111111111
GPT10000000000
Gemini 2.511111111111
Gemini 3.111111111111
Claude (thinking)11111111111
14Claude1112121212121212121212
GPT110000200200
Gemini 2.5111099101010910910
Gemini 3.11111111111111110101111
Claude (thinking)1114121314121412141114
15Claude20000000000
GPT20000000000
Gemini 2.522223342432
Gemini 3.122222222222
Claude (thinking)22222000222
16Claude76666666666
GPT70000000000
Gemini 2.574444334433
Gemini 3.177777777777
Claude (thinking)77776767677
17Claude22222222222
GPT20000000000
Gemini 2.521221212122
Gemini 3.122222222222
Claude (thinking)22222223222
18Claude68778777777
GPT60000000000
Gemini 2.566666666666
Gemini 3.166666666666
Claude (thinking)66766789586
19Claude22222222222
GPT20000000000
Gemini 2.521111111111
Gemini 3.124444444444
Claude (thinking)22222222222
20Claude24444444444
GPT20000000000
Gemini 2.520000000000
Gemini 3.123333333233
Claude (thinking)22222224234
21Claude32333232333
GPT30000000000
Gemini 2.531112121211
Gemini 3.132222222222
Claude (thinking)32323222223
22Claude44444454444
GPT40000000000
Gemini 2.540000000000
Gemini 3.144444444444
Claude (thinking)47753566564
23Claude23333333333
GPT20000000000
Gemini 2.521221121111
Gemini 3.124444444444
Claude (thinking)23223322224
24Claude00000000000
GPT00000000000
Gemini 2.500000000000
Gemini 3.100000000000
Claude (thinking)00200000040
25Claude00000000000
GPT00000000000
Gemini 2.500000000000
Gemini 3.100000000000
Claude (thinking)00000000000
26Claude810101010101010101010
GPT80000000000
Gemini 2.587676777777
Gemini 3.186666666666
Claude (thinking)88788889898
27Claude00000000000
GPT00000000000
Gemini 2.500110010100
Gemini 3.100000000000
Claude (thinking)00000000000
28Claude91010106101010101010
GPT90000000000
Gemini 2.598668866866
Gemini 3.1910101010101010101010
Claude (thinking)910913910109101111
29Claude44444444444
GPT40000000000
Gemini 2.542333322333
Gemini 3.143333333333
Claude (thinking)44454445443
30Claude85555555555
GPT80000000000
Gemini 2.587777867766
Gemini 3.188866886886
Claude (thinking)89108911798108
31Claude00000000000
GPT00000000000
Gemini 2.500000000000
Gemini 3.100000000000
Claude (thinking)00400000000
32Claude00000000000
GPT00000000000
Gemini 2.500000000000
Gemini 3.100000000000
Claude (thinking)00000004000
33Claude00023520520
GPT00060060460
Gemini 2.500000000000
Gemini 3.100000000000
Claude (thinking)05165346014
34Claude00000000000
GPT00000000000
Gemini 2.500000000000
Gemini 3.100000000000
Claude (thinking)06665300170
35Claude40000000000
GPT40000000600
Gemini 2.544040044000
Gemini 3.144444444444
Claude (thinking)44544444443
36Claude00000000000
GPT00000000000
Gemini 2.500000000000
Gemini 3.100000000000
Claude (thinking)00000000000
37Claude00000000000
GPT00000000000
Gemini 2.500000000000
Gemini 3.101111111111
Claude (thinking)00000000000
38Claude52117212414212121021
GPT50000000000
Gemini 2.555552555555
Gemini 3.155555455555
Claude (thinking)518170125186000
39Claude00000000000
GPT00000000000
Gemini 2.500000000000
Gemini 3.100000000000
Claude (thinking)00000000020

Guided (with expert guidance)

PageModelGTr1r2r3r4r5r6r7r8r9r10
1Claude1012121213121212131313
GPT100000000000
Gemini 2.5104400004404
Gemini 3.11010111010101011101010
Claude (thinking)1010111010911101089
2Claude22222222—22
GPT20000000000
Gemini 2.520000000000
Gemini 3.122232222222
Claude (thinking)22222222222
3Claude11101111110
GPT10000000000
Gemini 2.510111111000
Gemini 3.111111011111
Claude (thinking)11011111000
4Claude1312121212121212121212
GPT130000000000
Gemini 2.51312121012121012121010
Gemini 3.11313101312131213131313
Claude (thinking)1313171312111612141314
5Claude79999999999
GPT70000000000
Gemini 2.577776767777
Gemini 3.176666666666
Claude (thinking)77787788887
6Claude20000000000
GPT20000000000
Gemini 2.520000000000
Gemini 3.120000000000
Claude (thinking)21000000000
7Claude12222201222
GPT10000000000
Gemini 2.510000000010
Gemini 3.110000010220
Claude (thinking)11111111111
8Claude66666666666
GPT60000000000
Gemini 2.564654545654
Gemini 3.167686666667
Claude (thinking)66767886679
9Claude1213131313131313131313
GPT120100010120000
Gemini 2.51211121112131111131213
Gemini 3.11213121213131213111312
Claude (thinking)121791815111315131313
10Claude56666666666
GPT50000000000
Gemini 2.555555555555
Gemini 3.156555556655
Claude (thinking)57866556566
11Claude119999999999
GPT110000000000
Gemini 2.5119910101010—101010
Gemini 3.11111101111111110111110
Claude (thinking)111317910121512141011
12Claude24444444444
GPT20000000000
Gemini 2.522222222121
Gemini 3.122222222222
Claude (thinking)22122422221
13Claude11111111111
GPT10000000000
Gemini 2.511111111111
Gemini 3.111111111111
Claude (thinking)11111111111
14Claude1112121212121212121212
GPT110000000000
Gemini 2.5118881198911119
Gemini 3.11111111110101110101010
Claude (thinking)1111121313111214131415
15Claude20000000000
GPT20000000000
Gemini 2.522222222222
Gemini 3.122222222222
Claude (thinking)20022222022
16Claude76666666666
GPT70000000000
Gemini 2.574555555455
Gemini 3.176666666666
Claude (thinking)77666766676
17Claude22222223222
GPT20000000000
Gemini 2.521110121101
Gemini 3.120003033030
Claude (thinking)22222222222
18Claude66787767777
GPT60000000000
Gemini 2.566666666666
Gemini 3.166666666666
Claude (thinking)68766677776
19Claude22222222222
GPT20000000000
Gemini 2.521111111111
Gemini 3.124222242222
Claude (thinking)22222222222
20Claude20022022200
GPT20000000000
Gemini 2.520000000000
Gemini 3.123333332233
Claude (thinking)20220000000
21Claude33333333333
GPT30000000000
Gemini 2.531111110101
Gemini 3.132232222322
Claude (thinking)32222222222
22Claude43333333333
GPT40000000000
Gemini 2.540000000000
Gemini 3.144444444444
Claude (thinking)43526344433
23Claude23322222222
GPT20000000000
Gemini 2.521111111111
Gemini 3.124444444444
Claude (thinking)22222222222
24Claude00000000000
GPT00000000000
Gemini 2.500000000000
Gemini 3.101000111100
Claude (thinking)00000000000
25Claude00000000000
GPT00000000000
Gemini 2.500000000000
Gemini 3.100000000000
Claude (thinking)00000000000
26Claude899999101010910
GPT80000000000
Gemini 2.587777775577
Gemini 3.188888788888
Claude (thinking)8889898710810
27Claude0000000—000
GPT00000000000
Gemini 2.500000—0000—
Gemini 3.100000000000
Claude (thinking)00000000000
28Claude91111313130
GPT90000000000
Gemini 2.5910710971077910
Gemini 3.191098999101089
Claude (thinking)92967629007
29Claude44444444444
GPT40000000000
Gemini 2.542443223442
Gemini 3.144334443333
Claude (thinking)44435445444
30Claude84466—4646—
GPT80000000000
Gemini 2.587776776766
Gemini 3.188788887887
Claude (thinking)879879810788
31Claude00000000000
GPT00000000000
Gemini 2.500000000000
Gemini 3.100000000000
Claude (thinking)00000000000
32Claude00000000000
GPT00000000000
Gemini 2.500000000000
Gemini 3.100000000000
Claude (thinking)00000000000
33Claude00000000000
GPT00000000000
Gemini 2.500000000000
Gemini 3.100001010000
Claude (thinking)00000000000
34Claude00000000000
GPT00000000000
Gemini 2.500000000000
Gemini 3.100000000000
Claude (thinking)00000000200
35Claude40000000000
GPT40000000000
Gemini 2.540000000000
Gemini 3.144444444444
Claude (thinking)40000001404
36Claude00000000000
GPT00000000000
Gemini 2.500000000000
Gemini 3.100000000000
Claude (thinking)00000000000
37Claude00000000000
GPT00000000000
Gemini 2.500000000000
Gemini 3.100000000000
Claude (thinking)00000000000
38Claude50000000000
GPT50000000000
Gemini 2.555550005005
Gemini 3.155445544454
Claude (thinking)50000005000
39Claude00000000000
GPT00000000000
Gemini 2.500000000000
Gemini 3.100000000000
Claude (thinking)00000000000
Q9: Con count

Naive (no expert guidance)

PageModelGTr1r2r3r4r5r6r7r8r9r10
1Claude45555555555
GPT41222323223
Gemini 2.544444444444
Gemini 3.144444444444
Claude (thinking)44444444444
2Claude99979999999
GPT96676466576
Gemini 2.59911111199119119
Gemini 3.1999999109999
Claude (thinking)910989897888
3Claude11111111111
GPT10000000000
Gemini 2.511111111111
Gemini 3.111111111111
Claude (thinking)11111111111
4Claude76656566666
GPT74442222222
Gemini 2.577767676667
Gemini 3.176666666666
Claude (thinking)77777776777
5Claude22222222222
GPT24444343424
Gemini 2.524555454445
Gemini 3.122222222222
Claude (thinking)22222222222
6Claude88878878888
GPT83434432222
Gemini 2.588777788877
Gemini 3.187777767777
Claude (thinking)87997878777
7Claude22222222222
GPT22222222222
Gemini 2.522222222222
Gemini 3.122222222222
Claude (thinking)22222222222
8Claude1410121210121012101212
GPT1467676106979
Gemini 2.51413131313131313131313
Gemini 3.11414141414141414141414
Claude (thinking)1413121212131113131313
9Claude33444434443
GPT32222222232
Gemini 2.534443434433
Gemini 3.133333333333
Claude (thinking)33323333333
10Claude1512121212121212121212
GPT154645856476
Gemini 2.51514151514141414141514
Gemini 3.11514141414141515141414
Claude (thinking)1512131314131312141215
11Claude15101010101010109910
GPT1510891088109109
Gemini 2.51515151515151515151515
Gemini 3.11511111111111111111111
Claude (thinking)1512111111121110101113
12Claude98788888888
GPT97777664767
Gemini 2.599989989999
Gemini 3.199999999999
Claude (thinking)99999999999
13Claude11111111111
GPT11111111111
Gemini 2.511111111111
Gemini 3.111111111111
Claude (thinking)11111111111
14Claude55555555544
GPT53447644455
Gemini 2.555555555555
Gemini 3.155555555555
Claude (thinking)55554555554
15Claude11111111111
GPT11112112111
Gemini 2.512222212121
Gemini 3.111111111111
Claude (thinking)11111111111
16Claude54444444445
GPT52424441242
Gemini 2.555555555555
Gemini 3.155555555555
Claude (thinking)55555555555
17Claude54444444444
GPT52223223232
Gemini 2.556556565655
Gemini 3.154444444444
Claude (thinking)55555544455
18Claude34444444444
GPT34444434343
Gemini 2.533333232244
Gemini 3.133333333333
Claude (thinking)33333333433
19Claude77777777777
GPT72445645455
Gemini 2.578888888888
Gemini 3.176666666666
Claude (thinking)77777877877
20Claude76666666666
GPT76686766467
Gemini 2.578888888888
Gemini 3.177777777677
Claude (thinking)77777777777
21Claude44444444444
GPT42232222222
Gemini 2.544444444444
Gemini 3.144444444444
Claude (thinking)44345455444
22Claude1110101010101010101010
GPT1181089689999
Gemini 2.51111121313111311131212
Gemini 3.11110101010101010101010
Claude (thinking)1110121011121111111011
23Claude66666666666
GPT65556565466
Gemini 2.566666666666
Gemini 3.165555555555
Claude (thinking)66666666666
24Claude11111111111
GPT11212112212
Gemini 2.511111111111
Gemini 3.111111111111
Claude (thinking)11111111111
25Claude65565556566
GPT65664564554
Gemini 2.566666666666
Gemini 3.166666666666
Claude (thinking)66666666666
26Claude24242422424
GPT22222000040
Gemini 2.524333334434
Gemini 3.122222222222
Claude (thinking)22322233242
27Claude1212121212121214121414
GPT126457466666
Gemini 2.51212121211121212121112
Gemini 3.11210101010101010101010
Claude (thinking)1213131211121312121213
28Claude46556556556
GPT44634445444
Gemini 2.544444444444
Gemini 3.144444444444
Claude (thinking)45555555555
29Claude22222222222
GPT22232222222
Gemini 2.522222222222
Gemini 3.122222222222
Claude (thinking)22222222222
30Claude11111111111
GPT10000000000
Gemini 2.511111111111
Gemini 3.111111111111
Claude (thinking)11111111111
31Claude23333333333
GPT21142244222
Gemini 2.522222222222
Gemini 3.122222222222
Claude (thinking)22222222222
32Claude76666656666
GPT75664625643
Gemini 2.577777777777
Gemini 3.176666666666
Claude (thinking)77777776767
33Claude43333333333
GPT44333334433
Gemini 2.543333333333
Gemini 3.144444444444
Claude (thinking)43443444443
34Claude88881087810108
GPT86665665656
Gemini 2.588888888888
Gemini 3.187777777787
Claude (thinking)88888888888
35Claude13333333333
GPT11111111101
Gemini 2.511111111111
Gemini 3.111111111111
Claude (thinking)12332213211
36Claude1010101010101010101010
GPT106446644564
Gemini 2.5109999999999
Gemini 3.1108888888888
Claude (thinking)1010109101010109911
37Claude1612121212121212121212
GPT169778888767
Gemini 2.51616161516161616151615
Gemini 3.11616161616161616161616
Claude (thinking)161314912121213131212
38Claude11111111111
GPT12121221221
Gemini 2.512223342233
Gemini 3.111111111111
Claude (thinking)12222222222
39Claude23332322332
GPT21111111011
Gemini 2.522222222222
Gemini 3.122222222222
Claude (thinking)22222222222

Guided (with expert guidance)

PageModelGTr1r2r3r4r5r6r7r8r9r10
1Claude43333333333
GPT43332112212
Gemini 2.544444444444
Gemini 3.144444444444
Claude (thinking)44444444444
2Claude97777777—77
GPT94666566666
Gemini 2.599999999999
Gemini 3.198888888888
Claude (thinking)97988878978
3Claude11111111111
GPT10000000000
Gemini 2.511111111111
Gemini 3.111111111111
Claude (thinking)11111111111
4Claude76655656555
GPT73344344244
Gemini 2.577777777777
Gemini 3.177677777777
Claude (thinking)76677777777
5Claude22222222222
GPT23334333434
Gemini 2.523332342233
Gemini 3.122222222222
Claude (thinking)22222222222
6Claude87777777777
GPT84344454443
Gemini 2.587776777777
Gemini 3.186777777777
Claude (thinking)89899988977
7Claude22222222222
GPT22222222222
Gemini 2.522222222222
Gemini 3.122222222222
Claude (thinking)22222222222
8Claude141010101091010101010
GPT147987688787
Gemini 2.51414141314131413141414
Gemini 3.11412141114141414141413
Claude (thinking)141311101411111491211
9Claude33333334333
GPT32222222222
Gemini 2.534444344343
Gemini 3.133333333333
Claude (thinking)33333223223
10Claude1510101010101010101012
GPT158664747568
Gemini 2.51514141414141414131414
Gemini 3.11512151514121512121214
Claude (thinking)1511111112121413111211
11Claude15101010101071010810
GPT15810799109799
Gemini 2.515151515151515—151515
Gemini 3.11515141111151114151514
Claude (thinking)1510111210101110151012
12Claude97777777777
GPT98788977887
Gemini 2.599999999999
Gemini 3.199989989989
Claude (thinking)99999999999
13Claude11111111111
GPT11111111111
Gemini 2.511111111111
Gemini 3.111111111111
Claude (thinking)11111111111
14Claude55555555555
GPT54668246644
Gemini 2.555555555555
Gemini 3.155554554545
Claude (thinking)55554455555
15Claude11111111111
GPT12221111111
Gemini 2.511111111111
Gemini 3.111111111111
Claude (thinking)11111111111
16Claude54445454443
GPT55650550000
Gemini 2.555555555555
Gemini 3.155555555555
Claude (thinking)55555554555
17Claude55554545555
GPT52333333343
Gemini 2.554445464454
Gemini 3.156655555656
Claude (thinking)55555555555
18Claude33333333333
GPT34333334242
Gemini 2.533433333333
Gemini 3.133333333333
Claude (thinking)33333333333
19Claude76666666666
GPT73343334333
Gemini 2.576888678687
Gemini 3.176777767777
Claude (thinking)77777677677
20Claude76666666666
GPT74557546556
Gemini 2.577888788877
Gemini 3.176666767766
Claude (thinking)77777777777
21Claude44444444444
GPT43233333333
Gemini 2.544444444444
Gemini 3.144444444444
Claude (thinking)44344444444
22Claude117777777777
GPT118679996779
Gemini 2.51112111211111111111213
Gemini 3.11110101010111111101010
Claude (thinking)1111101211101213101211
23Claude65555555555
GPT65334244444
Gemini 2.566666666666
Gemini 3.165555555555
Claude (thinking)66666656666
24Claude11111111111
GPT11111111111
Gemini 2.511111111111
Gemini 3.111111111111
Claude (thinking)11111111111
25Claude65555555555
GPT65454455444
Gemini 2.566666666666
Gemini 3.166666666666
Claude (thinking)66666666666
26Claude22222222222
GPT22142122222
Gemini 2.524334334444
Gemini 3.122222222222
Claude (thinking)22222222222
27Claude12101010101010—101010
GPT124486636686
Gemini 2.51212121212—12121212—
Gemini 3.11210101010101010101010
Claude (thinking)1212121111121112111111
28Claude45555555555
GPT44644565546
Gemini 2.545455454455
Gemini 3.144444444444
Claude (thinking)45555555555
29Claude22222222222
GPT24222222222
Gemini 2.522222222222
Gemini 3.122222222222
Claude (thinking)22222222222
30Claude11111—1111—
GPT10000000000
Gemini 2.511111111111
Gemini 3.111111111111
Claude (thinking)11111111111
31Claude22222222222
GPT21222122112
Gemini 2.522222222222
Gemini 3.122222222222
Claude (thinking)22222222222
32Claude76666666666
GPT75556656556
Gemini 2.577777777777
Gemini 3.176766666666
Claude (thinking)77777777777
33Claude43333333333
GPT43233332332
Gemini 2.543333333333
Gemini 3.144444444444
Claude (thinking)44443433434
34Claude89797999999
GPT87757597776
Gemini 2.588888888888
Gemini 3.187777777777
Claude (thinking)89888888888
35Claude13333333333
GPT11111111111
Gemini 2.511111111111
Gemini 3.111111111111
Claude (thinking)12231221213
36Claude1010101210101010101210
GPT105464454556
Gemini 2.5109999999999
Gemini 3.1108888888889
Claude (thinking)109810109101091011
37Claude1612121212121212121212
GPT168687077777
Gemini 2.51617161617171717171716
Gemini 3.11614141414141316141413
Claude (thinking)1611101011131411141013
38Claude11111111111
GPT12100101001
Gemini 2.511111111221
Gemini 3.111111111111
Claude (thinking)11111222222
39Claude22222222222
GPT21111111111
Gemini 2.522222222222
Gemini 3.122222222222
Claude (thinking)22222222222
Q11: E conjunction count

Naive (no expert guidance)

PageModelGTr1r2r3r4r5r6r7r8r9r10
1Claude68888888888
GPT62243432222
Gemini 2.566555655665
Gemini 3.164444444444
Claude (thinking)696897758107
2Claude35555555555
GPT34426342233
Gemini 2.533222472427
Gemini 3.131111121111
Claude (thinking)32233332423
3Claude11111111111
GPT10000000000
Gemini 2.512222222222
Gemini 3.111111111111
Claude (thinking)11111111111
4Claude33222222232
GPT36444434426
Gemini 2.534424242224
Gemini 3.132222222222
Claude (thinking)32222222222
5Claude32122222221
GPT30000000100
Gemini 2.532222222222
Gemini 3.133233331132
Claude (thinking)33323223233
6Claude23333333333
GPT24244322262
Gemini 2.521113111133
Gemini 3.121111111111
Claude (thinking)23233342434
7Claude00000000000
GPT00000000000
Gemini 2.501010011110
Gemini 3.100000000000
Claude (thinking)00000000000
8Claude35555555555
GPT32334202412
Gemini 2.534343233422
Gemini 3.134422224224
Claude (thinking)33445423434
9Claude45555555555
GPT41112211222
Gemini 2.544554545444
Gemini 3.142222222222
Claude (thinking)45344435433
10Claude37755757575
GPT36624642042
Gemini 2.537557777757
Gemini 3.133333322333
Claude (thinking)33365554643
11Claude85555555555
GPT84222462544
Gemini 2.5877107710101077
Gemini 3.181111211211
Claude (thinking)86555686766
12Claude75555555555
GPT74664444454
Gemini 2.5710109101091010810
Gemini 3.175554445554
Claude (thinking)74455556455
13Claude00000000000
GPT00000000000
Gemini 2.500044000040
Gemini 3.100000000000
Claude (thinking)00000000000
14Claude34444444433
GPT32444643435
Gemini 2.533333333333
Gemini 3.133333334433
Claude (thinking)33333333333
15Claude00000000000
GPT00000000000
Gemini 2.500000000000
Gemini 3.100000000000
Claude (thinking)00000000000
16Claude02222222222
GPT02211112022
Gemini 2.505353665356
Gemini 3.101111111111
Claude (thinking)02112222211
17Claude12222222222
GPT10111120100
Gemini 2.514224343432
Gemini 3.111111111111
Claude (thinking)11132223112
18Claude11111111111
GPT12212112221
Gemini 2.511111111122
Gemini 3.111111111111
Claude (thinking)11111111111
19Claude53354344334
GPT52134404240
Gemini 2.557373737733
Gemini 3.153331131333
Claude (thinking)53232443424
20Claude00002000002
GPT02112212111
Gemini 2.501211114422
Gemini 3.100000000000
Claude (thinking)00000002000
21Claude56666666666
GPT52476464434
Gemini 2.551264134136131212
Gemini 3.154444444444
Claude (thinking)55666365657
22Claude35566555555
GPT37006443122
Gemini 2.537488787744
Gemini 3.132222232232
Claude (thinking)34453545573
23Claude23333333333
GPT21122021121
Gemini 2.526775676556
Gemini 3.121111111111
Claude (thinking)22321432222
24Claude65533353533
GPT60000001100
Gemini 2.564444443444
Gemini 3.163133333333
Claude (thinking)61213302331
25Claude02222222222
GPT00210000010
Gemini 2.501111111155
Gemini 3.100000000000
Claude (thinking)02111111121
26Claude43333333333
GPT42111010222
Gemini 2.544333333433
Gemini 3.144433333443
Claude (thinking)43233234434
27Claude38888888888
GPT33244244322
Gemini 2.53761211712712117
Gemini 3.136666666666
Claude (thinking)37755558668
28Claude27677775767
GPT24664442643
Gemini 2.523443334344
Gemini 3.123333333333
Claude (thinking)23454354343
29Claude44433433344
GPT42212212112
Gemini 2.544333344333
Gemini 3.144444444444
Claude (thinking)44322323322
30Claude02212121112
GPT00000000000
Gemini 2.503332223322
Gemini 3.100000000000
Claude (thinking)00220210002
31Claude02222222220
GPT00000000000
Gemini 2.504444444444
Gemini 3.100000000000
Claude (thinking)00000000000
32Claude12222232222
GPT11210000000
Gemini 2.512332332003
Gemini 3.111111111111
Claude (thinking)11111112111
33Claude16666666666
GPT11012120111
Gemini 2.516334666444
Gemini 3.111111111111
Claude (thinking)14554355534
34Claude35565555555
GPT32121112122
Gemini 2.5377877713979
Gemini 3.132222222222
Claude (thinking)34544435544
35Claude02222222222
GPT01001100101
Gemini 2.502322222233
Gemini 3.101111111111
Claude (thinking)02222223214
36Claude45555555555
GPT40022222200
Gemini 2.54101010101081010104
Gemini 3.141111111111
Claude (thinking)45355355666
37Claude88888888888
GPT86766346666
Gemini 2.58535359539715715
Gemini 3.188888888858
Claude (thinking)897567105787
38Claude35454454545
GPT30000100000
Gemini 2.53111133111133
Gemini 3.132222222222
Claude (thinking)33445463353
39Claude00001000000
GPT00000000000
Gemini 2.500011100010
Gemini 3.100000000000
Claude (thinking)00000000000

Guided (with expert guidance)

PageModelGTr1r2r3r4r5r6r7r8r9r10
1Claude68888888888
GPT64242122122
Gemini 2.566666566656
Gemini 3.164444444444
Claude (thinking)67557556855
2Claude33333333—34
GPT30011111010
Gemini 2.536464664666
Gemini 3.132232222222
Claude (thinking)33223324332
3Claude10010010111
GPT10000000000
Gemini 2.512111111222
Gemini 3.111111111111
Claude (thinking)11111111111
4Claude32333333333
GPT33444444433
Gemini 2.532332232333
Gemini 3.132222222222
Claude (thinking)32222222222
5Claude31121112111
GPT30001100200
Gemini 2.532223222222
Gemini 3.133223223222
Claude (thinking)31313233313
6Claude23333333333
GPT21212221242
Gemini 2.521111111111
Gemini 3.121111111111
Claude (thinking)22422232234
7Claude00000000000
GPT00000000000
Gemini 2.500000000000
Gemini 3.100000000000
Claude (thinking)00000000000
8Claude35555555535
GPT32222122221
Gemini 2.532232323222
Gemini 3.132323333332
Claude (thinking)33223232233
9Claude47777776767
GPT40121212111
Gemini 2.542424422444
Gemini 3.143223323232
Claude (thinking)44445334444
10Claude37858787855
GPT37447444774
Gemini 2.536656225422
Gemini 3.133223223323
Claude (thinking)35535473454
11Claude85355555555
GPT84776477266
Gemini 2.58661010105—10105
Gemini 3.187212262217721
Claude (thinking)85855555757
12Claude75555555555
GPT74564445444
Gemini 2.578788878787
Gemini 3.174444644646
Claude (thinking)75767455464
13Claude00000000000
GPT00000000000
Gemini 2.500000000000
Gemini 3.100000000000
Claude (thinking)00000000000
14Claude36565665555
GPT32444234333
Gemini 2.533333333333
Gemini 3.133333333333
Claude (thinking)33333333333
15Claude00000000000
GPT00000000000
Gemini 2.500000000000
Gemini 3.100000000000
Claude (thinking)00000000000
16Claude02222222222
GPT00200220000
Gemini 2.503233322333
Gemini 3.101111111111
Claude (thinking)01112121211
17Claude12222222222
GPT11101111100
Gemini 2.512222222222
Gemini 3.111111111111
Claude (thinking)12111231212
18Claude11111111111
GPT11111121122
Gemini 2.511211111111
Gemini 3.111111111111
Claude (thinking)11111111111
19Claude54444455444
GPT52440220240
Gemini 2.551313113131
Gemini 3.153111331133
Claude (thinking)52334242354
20Claude00000000000
GPT00100000001
Gemini 2.502010211022
Gemini 3.100000000000
Claude (thinking)00000000000
21Claude58888888888
GPT52462244446
Gemini 2.555444445554
Gemini 3.154344334434
Claude (thinking)54637454555
22Claude35555555555
GPT32422212224
Gemini 2.533433334333
Gemini 3.133322333332
Claude (thinking)35423343544
23Claude23333333333
GPT20100012010
Gemini 2.525555555555
Gemini 3.121111111111
Claude (thinking)22121321212
24Claude64444444453
GPT60000000000
Gemini 2.565333335323
Gemini 3.163323333332
Claude (thinking)62121312121
25Claude02222222222
GPT00000000100
Gemini 2.501111111111
Gemini 3.101100000101
Claude (thinking)02111112212
26Claude43323333333
GPT40200000200
Gemini 2.543333333333
Gemini 3.144543345344
Claude (thinking)43444232423
27Claude3585555—585
GPT34442263224
Gemini 2.538958—5989—
Gemini 3.134363466446
Claude (thinking)36746555557
28Claude27777777778
GPT24633566446
Gemini 2.523433434433
Gemini 3.123333333333
Claude (thinking)23433334443
29Claude43333434333
GPT44222222211
Gemini 2.544444444444
Gemini 3.144444444444
Claude (thinking)42443443432
30Claude02222—2222—
GPT00000000000
Gemini 2.503330221201
Gemini 3.100000000000
Claude (thinking)01442020002
31Claude02222022222
GPT00000000000
Gemini 2.504444444444
Gemini 3.100000000000
Claude (thinking)03000000000
32Claude12222222222
GPT11210206210
Gemini 2.512232323223
Gemini 3.111111111111
Claude (thinking)11111221211
33Claude16666666666
GPT10220200202
Gemini 2.515255555255
Gemini 3.111111111111
Claude (thinking)15346357568
34Claude35555555555
GPT30000000000
Gemini 2.535510255105102
Gemini 3.132222122221
Claude (thinking)35436458424
35Claude02222222222
GPT00000000000
Gemini 2.502223232222
Gemini 3.100210000000
Claude (thinking)01212202426
36Claude45555555555
GPT42200000000
Gemini 2.543333434333
Gemini 3.142222222222
Claude (thinking)44454455452
37Claude85565566667
GPT82222034441
Gemini 2.58128812991291210
Gemini 3.183333336333
Claude (thinking)85668588686
38Claude34333433344
GPT30000000000
Gemini 2.53626101010211116
Gemini 3.132112211121
Claude (thinking)33423343134
39Claude00000000000
GPT00000000000
Gemini 2.500000000000
Gemini 3.100000000000
Claude (thinking)00000000000
Q13: Named travelers

Naive (no expert guidance)

PageModelGTr1r2r3r4r5r6r7r8r9r10
1Claude3442424242424242424242
GPT3429272525262525252525
Gemini 2.53433353235343235343435
Gemini 3.13426262628262826262626
Claude (thinking)3432343232323234323632
2Claude3532323232323232323232
GPT3526242626262425242524
Gemini 2.53537373737383937383739
Gemini 3.13528282828282928282828
Claude (thinking)3532363432363635323228
3Claude44455544545
GPT44333343343
Gemini 2.544444444444
Gemini 3.144444444444
Claude (thinking)44444444444
4Claude2832323232323232323232
GPT2825292526262926252526
Gemini 2.52830273030302730303029
Gemini 3.12822222222222222222222
Claude (thinking)2835283227323232293228
5Claude1114141414141414141414
GPT11101010912910121010
Gemini 2.51113171717131713131317
Gemini 3.11111111111111110101111
Claude (thinking)1111111111121111111111
6Claude2622222222222224222222
GPT2620222220182020202020
Gemini 2.52625252626252525252626
Gemini 3.12622222222222122222222
Claude (thinking)2622262222242225242322
7Claude68988888898
GPT67777787777
Gemini 2.567777777777
Gemini 3.166666666666
Claude (thinking)66666666666
8Claude4342454542454245424245
GPT4329292929332933273329
Gemini 2.54344484448464848444746
Gemini 3.14342424242424242424242
Claude (thinking)4342383838383842383838
9Claude3335353532353235353235
GPT3326242726272625292429
Gemini 2.53334363634363436343434
Gemini 3.13326262626262626262626
Claude (thinking)3332333132283234323233
10Claude5352585252525258525252
GPT5333384439444433444439
Gemini 2.55353535353535353535353
Gemini 3.15354545454545353545454
Claude (thinking)5348484247484748474748
11Claude6272686868686868686868
GPT6255556355555555556055
Gemini 2.56263636363636363636363
Gemini 3.16248484848484848484848
Claude (thinking)6267646758676252586262
12Claude3835354235424235424242
GPT3829273329293329303030
Gemini 2.53837373737373737373837
Gemini 3.13825252528282825252528
Claude (thinking)3832322838383835323228
13Claude67677777777
GPT66666666666
Gemini 2.566777777677
Gemini 3.166666666666
Claude (thinking)66666666666
14Claude2232323232283232282424
GPT2220181818182020181818
Gemini 2.52222222122222222222222
Gemini 3.12222222222222216162222
Claude (thinking)2228232423222422232224
15Claude56666666666
GPT55585765555
Gemini 2.555555555555
Gemini 3.155555555555
Claude (thinking)55555555555
16Claude2018222218221822221818
GPT2016161820181818201818
Gemini 2.52022222222232322222223
Gemini 3.12017181717181718171817
Claude (thinking)2020202020182018182019
17Claude1415141514141414151514
GPT1411121211111112111012
Gemini 2.51414131314151415141513
Gemini 3.11412121212121212121212
Claude (thinking)1414141214141414141414
18Claude1112121212121212121212
GPT1191010101091010910
Gemini 2.51111111111111111111111
Gemini 3.11111111111111111111111
Claude (thinking)1111111111111211111111
19Claude2624242424242424242424
GPT2623221820222223232020
Gemini 2.52628242824282428282424
Gemini 3.12622222222222222222222
Claude (thinking)2624242626282428242423
20Claude2224242424242424242424
GPT2218181818181818181818
Gemini 2.52224262424242422222626
Gemini 3.12220202020202020202020
Claude (thinking)2222222222222222222222
21Claude2728282828282828282828
GPT2724222018202022222222
Gemini 2.52729273229322927292929
Gemini 3.12723232323232323232323
Claude (thinking)2727262628272728272728
22Claude2124242424242424242424
GPT2115181516161518151415
Gemini 2.52123222525232523252222
Gemini 3.12119191919191819191819
Claude (thinking)2121212121242222222119
23Claude3332323232323232323235
GPT3320222224222422202224
Gemini 2.53331323233313231333331
Gemini 3.13328282828282828282828
Claude (thinking)3332323232323228323232
24Claude2222222424242224222424
GPT2218181918202020191920
Gemini 2.52224222424222422242222
Gemini 3.12219201919191919191919
Claude (thinking)2218202122212020212120
25Claude1213141313131313131313
GPT1212111011111011111110
Gemini 2.51212121212121212121212
Gemini 3.11211111111111111111111
Claude (thinking)1212121213121212121212
26Claude2428283228322828282832
GPT241822202222220201822
Gemini 2.52426242424242424262424
Gemini 3.12420201919191919202119
Claude (thinking)2422222022222224222324
27Claude3535353535353542424242
GPT3524202424182422222026
Gemini 2.53536363335363336333536
Gemini 3.13528282828282828282828
Claude (thinking)3538383232323234383238
28Claude1924242424242424242424
GPT1916181816181818161818
Gemini 2.51920202020201920202020
Gemini 3.11917171717171717171717
Claude (thinking)1918192218202220222022
29Claude1314141414141414141414
GPT1315131313131413131413
Gemini 2.51314141314141414131414
Gemini 3.11313131313131313131313
Claude (thinking)1313131313131113131313
30Claude2224282428242424242428
GPT2220222218222225202422
Gemini 2.52222222222222222222222
Gemini 3.12218182121181821181821
Claude (thinking)2222222224222222232222
31Claude1414141414141412141414
GPT1412121212141414141212
Gemini 2.51414141414141414141414
Gemini 3.11412121212121212121212
Claude (thinking)1414141414101410141414
32Claude1614141616141414151414
GPT1612141514141415141314
Gemini 2.51615161615161615151514
Gemini 3.11613131313131313131313
Claude (thinking)1614141414141615141614
33Claude1818181818181818181818
GPT1812101210121212121214
Gemini 2.51821181820212121202020
Gemini 3.11816161616161616161616
Claude (thinking)1816181818181718171817
34Claude2924282824282424242428
GPT2920181820201920182020
Gemini 2.52928282628282827262826
Gemini 3.12922222222222222222422
Claude (thinking)2925242624272625262624
35Claude1718181818181818181818
GPT1715151515141414141515
Gemini 2.51717171717171717171717
Gemini 3.11716161616161616161616
Claude (thinking)1717171817171720171719
36Claude3742424235424242423542
GPT3722242420242224222424
Gemini 2.53737373737373837383836
Gemini 3.13728282828282828282828
Claude (thinking)3728362836323234283232
37Claude4942424242424242424242
GPT4928333333332433333333
Gemini 2.54951514950515050495049
Gemini 3.14948484848484848484848
Claude (thinking)4934383442363838424238
38Claude3142354242424242423542
GPT3125253025252526252526
Gemini 2.53131313129303031313030
Gemini 3.13125252525262525252525
Claude (thinking)3133322838323528323233
39Claude1010101010101010101010
GPT108999998898
Gemini 2.51010101010101010101010
Gemini 3.1109999999999
Claude (thinking)1010101010101010101010

Guided (with expert guidance)

PageModelGTr1r2r3r4r5r6r7r8r9r10
1Claude3435353535353535353535
GPT3424252626252626252525
Gemini 2.53435353435343535353435
Gemini 3.13426262626262626262626
Claude (thinking)3435333335323532323228
2Claude3532353535353535—3535
GPT3529312929313331293131
Gemini 2.53537383738373738373737
Gemini 3.13528283128282830303028
Claude (thinking)3536373235323634373835
3Claude45545555555
GPT44444444444
Gemini 2.544444444554
Gemini 3.144444444444
Claude (thinking)44444444444
4Claude2832323535353535353535
GPT2829293434333434313134
Gemini 2.52830292930302930292929
Gemini 3.12829232829292929282928
Claude (thinking)2838423832424228353827
5Claude1117171717181717181717
GPT1113111314141411111312
Gemini 2.51110101012101211111010
Gemini 3.11110101010111110111110
Claude (thinking)1111111111111112111110
6Claude2624242424242424242424
GPT2625232325232323232225
Gemini 2.52625252526252525252525
Gemini 3.12623222222232222222222
Claude (thinking)2625262526252424252624
7Claude69999988999
GPT67777777666
Gemini 2.567777777777
Gemini 3.166666666666
Claude (thinking)66666666666
8Claude4342424242424242424242
GPT4334343434393934333434
Gemini 2.54345474845484548474245
Gemini 3.14334423442424242424236
Claude (thinking)4342434742424242384342
9Claude3335353535353535353535
GPT3325312629312925262926
Gemini 2.53335383538363535363836
Gemini 3.13333282833332833283326
Claude (thinking)3332313238322832293228
10Claude5352585852625862585252
GPT5355525246525246525252
Gemini 2.55353535353535353535353
Gemini 3.15344535353435344444353
Claude (thinking)5352524752484752484848
11Claude6272686868726868686868
GPT6262635563626255626263
Gemini 2.562646464646463—646463
Gemini 3.16262604848624860626260
Claude (thinking)6258586258585856565468
12Claude3835353535423535354235
GPT3834333429313333312934
Gemini 2.53838383838383838383838
Gemini 3.13832313231373232373237
Claude (thinking)3838344238363335363838
13Claude68888888888
GPT67777777777
Gemini 2.566667766766
Gemini 3.166666666666
Claude (thinking)66666666666
14Claude2228282828282824282828
GPT2225232223232520232522
Gemini 2.52222222222212226222226
Gemini 3.12222222218202217201720
Claude (thinking)2224242322252424232424
15Claude56666666666
GPT56878688657
Gemini 2.555555555555
Gemini 3.155555555555
Claude (thinking)55555555555
16Claude2022212121212121212121
GPT2018181718191818181718
Gemini 2.52020202020202020202020
Gemini 3.12016161616161716171716
Claude (thinking)2020212020181918202020
17Claude1415151513151317151515
GPT1411121111121112111213
Gemini 2.51415151514151515151415
Gemini 3.11414141413141313141314
Claude (thinking)1414141414141414141414
18Claude1110121212121012121212
GPT111110111111111010119
Gemini 2.51111121112111212111111
Gemini 3.11110101010101011101011
Claude (thinking)1111111111111111111111
19Claude2628282828282828282828
GPT2626252323232929262322
Gemini 2.52631312731312731313127
Gemini 3.12622212121222221212121
Claude (thinking)2626282826242828262428
20Claude2224242424242424242424
GPT2221212222212222222221
Gemini 2.52223242524232424242323
Gemini 3.12219191919221920201919
Claude (thinking)2222222022222222222222
21Claude2728282832282828283228
GPT2729252625252225252323
Gemini 2.52731282828292932313229
Gemini 3.12725242523242423242423
Claude (thinking)2727272727272727272727
22Claude2124242424242424242421
GPT2119181920201821201919
Gemini 2.52122232225252523252222
Gemini 3.12118191818212121191918
Claude (thinking)2123222222242222232221
23Claude3335353232323535353535
GPT3331292929312929292931
Gemini 2.53330313130323232313030
Gemini 3.13326262626262626262626
Claude (thinking)3335323233323232323232
24Claude2224242424242424242824
GPT2219181717171818171817
Gemini 2.52226212121212126212621
Gemini 3.12218181818182318231819
Claude (thinking)2222222222242222222220
25Claude1214141414141414141414
GPT1211111111111113111112
Gemini 2.51212121212121212121212
Gemini 3.11212121111111112121112
Claude (thinking)1213121212121212121212
26Claude2432322832323228323232
GPT2425252422232523232322
Gemini 2.52426262626262626262626
Gemini 3.12424242419202424192424
Claude (thinking)2424242424282828262828
27Claude35424242424242—424242
GPT3526293331312926292924
Gemini 2.53534383434—34383438—
Gemini 3.13528282828282828282828
Claude (thinking)3532383232383238323235
28Claude1926242424242424242425
GPT1922201822202220222120
Gemini 2.51920202020202020202020
Gemini 3.11916191619191916161619
Claude (thinking)1920192827281821242429
29Claude1317171517171717171717
GPT1317171515131713131414
Gemini 2.51313131313131313131313
Gemini 3.11313131313131313131313
Claude (thinking)1313131313131313131313
30Claude2228282828—28282828—
GPT2226232225202323222925
Gemini 2.52223232322222222222222
Gemini 3.12222202222222220222220
Claude (thinking)2223232222222222232222
31Claude1412121012101210121212
GPT1411131210111211141013
Gemini 2.51415151515151515151515
Gemini 3.11412121212121212121212
Claude (thinking)1414141414141414141414
32Claude1617171717171717171817
GPT1613141415141314141415
Gemini 2.51615151615161516151516
Gemini 3.11613161414141313131414
Claude (thinking)1616161716161614151616
33Claude1822221822212122222222
GPT1813111311111113111112
Gemini 2.51820222121202020222121
Gemini 3.11815161616151616161616
Claude (thinking)1819181818181918181818
34Claude2928282828282828282828
GPT2923212120202322232122
Gemini 2.52928282829282828282829
Gemini 3.12924242424242424242424
Claude (thinking)2927282828262628272628
35Claude1722242421242424212121
GPT1715151714141516171614
Gemini 2.51717171717171717171717
Gemini 3.11717171617171717171717
Claude (thinking)1717171717181717201719
36Claude3742323535423535353542
GPT3726292525252423292323
Gemini 2.53737373737373637363637
Gemini 3.13728292929282928292828
Claude (thinking)3735353532323832383632
37Claude4952525252524252425252
GPT494644444404444394443
Gemini 2.54948505048505048504849
Gemini 3.14940404040383848383838
Claude (thinking)4938424242424538424842
38Claude3135383535353535423835
GPT3131253429293129292931
Gemini 2.53130313031313131313130
Gemini 3.13122262622222525253125
Claude (thinking)3132313230323133323232
39Claude1011101010101011101110
GPT10910101010910101010
Gemini 2.51010101010101010101010
Gemini 3.1109999999999
Claude (thinking)1010101010101010101010
Q14: Unnamed travelers

Naive (no expert guidance)

PageModelGTr1r2r3r4r5r6r7r8r9r10
1Claude1212121212121212121212
GPT1298994129899
Gemini 2.51214111111131111131311
Gemini 3.11212121212121212121212
Claude (thinking)1212121212121212121312
2Claude1812121212121212121212
GPT1810101210121210101412
Gemini 2.51812141414121214121412
Gemini 3.11814141414141614141414
Claude (thinking)1891299111291188
3Claude55555555555
GPT55000555010
Gemini 2.556556655655
Gemini 3.155555555555
Claude (thinking)55555555555
4Claude88888888888
GPT8101087788977
Gemini 2.5888989899910
Gemini 3.186666666666
Claude (thinking)898789810888
5Claude43233333332
GPT44433343424
Gemini 2.547777777777
Gemini 3.144444444444
Claude (thinking)44444444444
6Claude1012121212121212121212
GPT107788781010810
Gemini 2.51012111212111212121212
Gemini 3.11010101010101010101010
Claude (thinking)1010121411121012121112
7Claude22222222222
GPT22222222222
Gemini 2.522222222222
Gemini 3.122222222222
Claude (thinking)22222222222
8Claude3918282818281828182828
GPT391212101212912151216
Gemini 2.53938413841384141383838
Gemini 3.13939393939393939393939
Claude (thinking)3925222222223228234228
9Claude1181288888888
GPT116769767667
Gemini 2.51113131311131113131111
Gemini 3.11110101010101010101010
Claude (thinking)111411141291312121211
10Claude2628182428283518351824
GPT2614141210121210101212
Gemini 2.52636363636363636363636
Gemini 3.12624242424243838242424
Claude (thinking)2622262838222325232832
11Claude3318182525252218222222
GPT3322202020181823121823
Gemini 2.53332313332323333333231
Gemini 3.13328282828212828212828
Claude (thinking)3318192218181818181824
12Claude1812121515151512151215
GPT1810181812121610151516
Gemini 2.51818181518181518181818
Gemini 3.11816161616161616161616
Claude (thinking)1815161715181614181512
13Claude32222222222
GPT32222222222
Gemini 2.533322535325
Gemini 3.133333333333
Claude (thinking)32222222222
14Claude88888888887
GPT879810686987
Gemini 2.588898888888
Gemini 3.188888887788
Claude (thinking)87877887687
15Claude11111111111
GPT11112111111
Gemini 2.511111111111
Gemini 3.111111111111
Claude (thinking)11111111111
16Claude109101091091010109
GPT1011747865486
Gemini 2.51012121212101012121110
Gemini 3.11010101010101010101010
Claude (thinking)1010101010109109109
17Claude2323172317171717232317
GPT231616154151516151514
Gemini 2.52330232330253025302723
Gemini 3.12322222222222222222222
Claude (thinking)2323222222222225222323
18Claude56666666666
GPT55444544445
Gemini 2.555555353355
Gemini 3.155555555555
Claude (thinking)55555555555
19Claude1515151212151212151512
GPT151212912111014111211
Gemini 2.51517141715171517171415
Gemini 3.11512121211111211121212
Claude (thinking)1511121215171212141112
20Claude101010812101010101012
GPT106887776768
Gemini 2.51010101010101016161010
Gemini 3.1109999999999
Claude (thinking)1010108111011109910
21Claude1212121212121212121212
GPT1211151612151615151215
Gemini 2.51213101212121210121313
Gemini 3.11210101010101010101010
Claude (thinking)1212131112111112111112
22Claude1615151414151515151515
GPT1615141012121213151212
Gemini 2.51616161717161716171616
Gemini 3.11612121212121312121312
Claude (thinking)1614141414181516141412
23Claude888888888812
GPT8986877710710
Gemini 2.588888888888
Gemini 3.187777777777
Claude (thinking)898810999898
24Claude34456636455
GPT32420020400
Gemini 2.533433433344
Gemini 3.132322222222
Claude (thinking)32222222222
25Claude98868886866
GPT98897897887
Gemini 2.599999999999
Gemini 3.199999999999
Claude (thinking)99999999999
26Claude66666666666
GPT66000040044
Gemini 2.566676776676
Gemini 3.166666666666
Claude (thinking)66564666666
27Claude1718181818181818181818
GPT171289106010666
Gemini 2.51717201819171817181917
Gemini 3.11715151515151515151515
Claude (thinking)1719191818181818141918
28Claude1188128812812812
GPT1141210467612164
Gemini 2.51111111111111111111111
Gemini 3.111999999109910
Claude (thinking)1111981199109109
29Claude63322322243
GPT64434444342
Gemini 2.566555566555
Gemini 3.164466666666
Claude (thinking)66444544466
30Claude11111111111
GPT10000000000
Gemini 2.511111111111
Gemini 3.111111111111
Claude (thinking)11111111111
31Claude35555555554
GPT31000300032
Gemini 2.534444444444
Gemini 3.133333333333
Claude (thinking)33333333333
32Claude76666666666
GPT76875256766
Gemini 2.577777777777
Gemini 3.176666767666
Claude (thinking)77788877867
33Claude55555655655
GPT56666560446
Gemini 2.555444555343
Gemini 3.155555455554
Claude (thinking)55575657655
34Claude1614141510141214121514
GPT167787787887
Gemini 2.51623232523232323212321
Gemini 3.11615151515151515151515
Claude (thinking)1614161615161616151716
35Claude12222222222
GPT11111211202
Gemini 2.511111111111
Gemini 3.111111111111
Claude (thinking)11111111111
36Claude2218181810181818181518
GPT2212101012121212121012
Gemini 2.52221212121212221212121
Gemini 3.12220161616162016162016
Claude (thinking)2218221718181818171418
37Claude3518181828281828281818
GPT3522181514181616181816
Gemini 2.53569693934693434393439
Gemini 3.13536363636363636363636
Claude (thinking)3525241824222222231824
38Claude31111111111
GPT30100601601
Gemini 2.532225242222
Gemini 3.132222222222
Claude (thinking)32314131121
39Claude33334333333
GPT30000001001
Gemini 2.533333333333
Gemini 3.133333333333
Claude (thinking)33333333333

Guided (with expert guidance)

PageModelGTr1r2r3r4r5r6r7r8r9r10
1Claude1212121212121212121212
GPT1289118987993
Gemini 2.51212121414121412121212
Gemini 3.11212121212121212121212
Claude (thinking)1213131213131212121212
2Claude1812121210121212—1212
GPT187111010910981110
Gemini 2.51814141414141414141414
Gemini 3.11814141414141415151514
Claude (thinking)181212141312101314915
3Claude55555555555
GPT55555155155
Gemini 2.556555555556
Gemini 3.155555555555
Claude (thinking)55555555555
4Claude869888810887
GPT86777756976
Gemini 2.588888888888
Gemini 3.189688989898
Claude (thinking)8871289881098
5Claude43333333333
GPT43324242434
Gemini 2.547778743377
Gemini 3.144444444444
Claude (thinking)44444444444
6Claude1012141415151414141414
GPT108108810998109
Gemini 2.51013131110111111111313
Gemini 3.11011111110101011111111
Claude (thinking)1012141312121314141212
7Claude22222221222
GPT22222223322
Gemini 2.522222222222
Gemini 3.122222222222
Claude (thinking)22222222222
8Claude3935353535353535353535
GPT3912121213131711111413
Gemini 2.53939383839383938383939
Gemini 3.13932393439393939393933
Claude (thinking)3932382428383332183535
9Claude1115121213141015121212
GPT115404670644
Gemini 2.51118141814111818111411
Gemini 3.11111111111111111111111
Claude (thinking)1115131414101214121111
10Claude2626322635283228323532
GPT2612131315131115171313
Gemini 2.52636363636373736373737
Gemini 3.12621383836313821213136
Claude (thinking)2638281838323830322326
11Claude3325242422251824242224
GPT3318181114181717111718
Gemini 2.533303031313132—313132
Gemini 3.13333332626332633333333
Claude (thinking)3328322424222819222435
12Claude1817181818181818181818
GPT1816171814151515141314
Gemini 2.51819191519151915191919
Gemini 3.11818191818181818181818
Claude (thinking)1814151517181717161814
13Claude32222222222
GPT32222222222
Gemini 2.533333333333
Gemini 3.132222222222
Claude (thinking)32222222222
14Claude81011101291010121011
GPT860111387131008
Gemini 2.588888888888
Gemini 3.188887887878
Claude (thinking)88888788888
15Claude11111111111
GPT11111111111
Gemini 2.511111111111
Gemini 3.111111111111
Claude (thinking)11111111111
16Claude101110101110101010108
GPT10116125556686
Gemini 2.51010101010101010101010
Gemini 3.11010101010101010101010
Claude (thinking)1010111010101012101010
17Claude2324242423242424242424
GPT2366161616161615417
Gemini 2.52322222224222322222422
Gemini 3.12323222222222222222222
Claude (thinking)2325232223232223242324
18Claude56666666666
GPT54343435444
Gemini 2.555655555555
Gemini 3.155545555555
Claude (thinking)55555555555
19Claude1514121414121412121412
GPT15101111761199118
Gemini 2.51512121412121212121212
Gemini 3.11511111111111111111111
Claude (thinking)1514171514141413141415
20Claude1010101010101010101010
GPT105667566657
Gemini 2.51010111011101111111010
Gemini 3.11099991099999
Claude (thinking)1010121010101010111010
21Claude1212121212121212121212
GPT1211131312121113131113
Gemini 2.51212121212121212121212
Gemini 3.11210101011101011101011
Claude (thinking)1211141214121212121312
22Claude1615151514151514141415
GPT1613111113181311131112
Gemini 2.51616201616161620161617
Gemini 3.11613121313161616121213
Claude (thinking)1614141616151716181818
23Claude89101010101212101212
GPT87466576655
Gemini 2.588888888888
Gemini 3.187778777777
Claude (thinking)8127910101081289
24Claude36662264224
GPT32000000000
Gemini 2.532444442424
Gemini 3.133333333333
Claude (thinking)32222222222
25Claude99899999999
GPT98787788777
Gemini 2.599999999999
Gemini 3.199999999999
Claude (thinking)910999999999
26Claude66666666666
GPT66384646446
Gemini 2.566776776666
Gemini 3.166666666666
Claude (thinking)66666668666
27Claude17181815151815—181815
GPT177101311101012101012
Gemini 2.51717181917—19181718—
Gemini 3.11716151615161515161616
Claude (thinking)1722192118221816181818
28Claude1112121212121212121210
GPT11212561046464
Gemini 2.51111111111111111111111
Gemini 3.11191110111111991011
Claude (thinking)1111111214131111121211
29Claude62222222222
GPT60004020000
Gemini 2.566666666666
Gemini 3.166446664444
Claude (thinking)66666564666
30Claude11111—1111—
GPT10000000000
Gemini 2.511111111111
Gemini 3.111111111111
Claude (thinking)11111111111
31Claude33333333333
GPT33323333213
Gemini 2.534444444444
Gemini 3.133333333333
Claude (thinking)33333333333
32Claude77766666676
GPT76667667667
Gemini 2.577777777777
Gemini 3.176766666666
Claude (thinking)78787788887
33Claude56666666666
GPT54233332432
Gemini 2.553333333333
Gemini 3.155444544444
Claude (thinking)56555657857
34Claude1618171818181818181818
GPT169101080111211137
Gemini 2.51623232323232323232323
Gemini 3.11615151515151515151515
Claude (thinking)1614161621161618161818
35Claude11222222222
GPT11111111111
Gemini 2.511111111111
Gemini 3.111111111111
Claude (thinking)11111111111
36Claude2228262626262226242626
GPT22107165464556
Gemini 2.52221212121212121212121
Gemini 3.12220191920201920192020
Claude (thinking)2222182423222422191921
37Claude3532323232322832283232
GPT351310171401714181417
Gemini 2.53539353539363639363934
Gemini 3.13528282828282536282826
Claude (thinking)3524262828283432353228
38Claude31111111111
GPT30000000000
Gemini 2.532222222222
Gemini 3.133222322222
Claude (thinking)32121121122
39Claude33333333333
GPT32011111110
Gemini 2.533333333333
Gemini 3.133333333333
Claude (thinking)33333333333
Q15: Places of origin

Naive (no expert guidance)

PageModelGTr1r2r3r4r5r6r7r8r9r10
1Claude1715151515151515151515
GPT17878810810989
Gemini 2.51718171517141517141417
Gemini 3.11715151516141615151515
Claude (thinking)1712151412111215141212
2Claude2315151215151515151515
GPT236646444666
Gemini 2.52323212121222121222121
Gemini 3.12320202020202120202020
Claude (thinking)2316151416162115151812
3Claude22222222222
GPT21111211111
Gemini 2.522222222222
Gemini 3.122222222222
Claude (thinking)22222222222
4Claude1210101212101010101012
GPT123544334345
Gemini 2.51213111013101110101012
Gemini 3.11214121212141214141414
Claude (thinking)1210101111111012111011
5Claude55555555555
GPT54334444344
Gemini 2.555555555555
Gemini 3.156766667767
Claude (thinking)55555555554
6Claude1515151515151215151512
GPT15999108109999
Gemini 2.51514151314151414141414
Gemini 3.11516161616161616161616
Claude (thinking)1512151412141213141414
7Claude44444444444
GPT42212211212
Gemini 2.543333533335
Gemini 3.144444444444
Claude (thinking)44444434444
8Claude1912121212121212121212
GPT195444444644
Gemini 2.51914161416131616141413
Gemini 3.11921211919191921191921
Claude (thinking)1914121212121112121412
9Claude2118181815181818181518
GPT214446444446
Gemini 2.52121222222222222212222
Gemini 3.12121212121212121212121
Claude (thinking)2112181718121818181718
10Claude1915151812151515151218
GPT19101099109912108
Gemini 2.51921222221212121212225
Gemini 3.11918181818181919181818
Claude (thinking)1912141218121412161214
11Claude2228222222322832282828
GPT2291010987791010
Gemini 2.52227272627272626262727
Gemini 3.12226262626242626242626
Claude (thinking)2222181815161916202418
12Claude1715151518181815151518
GPT1710991010910101010
Gemini 2.51722222122222122222322
Gemini 3.11714141418181814141418
Claude (thinking)1712151212141415121412
13Claude34444444444
GPT31211212122
Gemini 2.534566353463
Gemini 3.133333333333
Claude (thinking)33333333333
14Claude1012121212101010101010
GPT103344444444
Gemini 2.5109109991010101010
Gemini 3.110999999161699
Claude (thinking)1091089101088810
15Claude55555555555
GPT54444454454
Gemini 2.555553345435
Gemini 3.155555555555
Claude (thinking)54444444444
16Claude78888888888
GPT76645444465
Gemini 2.579999889998
Gemini 3.1710101010101010101010
Claude (thinking)799878988108
17Claude76767777667
GPT74434444333
Gemini 2.574444444444
Gemini 3.177777777777
Claude (thinking)76675665667
18Claude56666666666
GPT56665566656
Gemini 2.556666565566
Gemini 3.155555555555
Claude (thinking)55555655655
19Claude1412121515121515121215
GPT148879879699
Gemini 2.51415161515151515151615
Gemini 3.11416161616161616161616
Claude (thinking)1414121213141414141213
20Claude1312121212121212121212
GPT136667666667
Gemini 2.51316121313161314141212
Gemini 3.11313131313131313131313
Claude (thinking)1311121012121210121212
21Claude1512121212121212121212
GPT15101091097910109
Gemini 2.51513131515151513151313
Gemini 3.11513141414141414141414
Claude (thinking)1512111213131212121412
22Claude1312121212121212121212
GPT137777767666
Gemini 2.51312121414121412131212
Gemini 3.11314141414141414141414
Claude (thinking)1312121212121212121211
23Claude2118181818181815151818
GPT211099997108910
Gemini 2.52118232320182320202018
Gemini 3.12121192121211919192121
Claude (thinking)2118141817151518181616
24Claude1312121212121212121212
GPT136665766656
Gemini 2.51315131515151515151513
Gemini 3.11314141414141414141414
Claude (thinking)1312121212101212121112
25Claude98788878878
GPT95556565656
Gemini 2.599999999999
Gemini 3.19101091091010101010
Claude (thinking)98109910998810
26Claude8101081081010101010
GPT84444440444
Gemini 2.588888888888
Gemini 3.1818181818181818181918
Claude (thinking)89778889998
27Claude1512121212121215121215
GPT157676666668
Gemini 2.51515171513151515151315
Gemini 3.11516161515161616161616
Claude (thinking)1512141212121212121212
28Claude1010101010101010101010
GPT104444444644
Gemini 2.51012111112121111121111
Gemini 3.11011111111111113111113
Claude (thinking)1091011111281010911
29Claude23333333333
GPT22112121112
Gemini 2.522222222222
Gemini 3.1213131313131313131313
Claude (thinking)22222222222
30Claude1010101010101010101010
GPT105555556656
Gemini 2.51010101011101110101111
Gemini 3.11010101010101010101010
Claude (thinking)1012121011101010101210
31Claude66666666666
GPT65455544455
Gemini 2.567666666766
Gemini 3.166666666666
Claude (thinking)66766777777
32Claude98888888888
GPT96676776676
Gemini 2.59101010101010108810
Gemini 3.1910101010101010101010
Claude (thinking)99899998999
33Claude1010101088101081010
GPT102433322332
Gemini 2.5109101010999101010
Gemini 3.11010101010101010101010
Claude (thinking)101099910999109
34Claude1412121212121212121212
GPT146666766767
Gemini 2.51415151415151514131513
Gemini 3.11412121212121212121212
Claude (thinking)1412121112121313111114
35Claude87877777777
GPT86656666566
Gemini 2.588888888888
Gemini 3.1814141414141414141414
Claude (thinking)88868788788
36Claude1918181815181818181818
GPT1912121212121212121212
Gemini 2.51918181818181818181818
Gemini 3.11918181818181818181818
Claude (thinking)1914181818181819151815
37Claude2522222222222222222222
GPT251210101212910121010
Gemini 2.52527272727272728272827
Gemini 3.12534343434343434342434
Claude (thinking)2518222022192418221918
38Claude118888888888
GPT116667765666
Gemini 2.51110101012111110101111
Gemini 3.11110101010101010101010
Claude (thinking)1199108897101110
39Claude99999999999
GPT98878777777
Gemini 2.5910101010101010101010
Gemini 3.198888888998
Claude (thinking)99999998999

Guided (with expert guidance)

PageModelGTr1r2r3r4r5r6r7r8r9r10
1Claude1715151515151515151515
GPT171011119910910911
Gemini 2.51719191818191819191919
Gemini 3.11715161515151516151515
Claude (thinking)1714141514141414141512
2Claude2312151515141515—1415
GPT2311111011111111111111
Gemini 2.52323232323272723242724
Gemini 3.12320202320202022222220
Claude (thinking)231491216141819171418
3Claude22222222222
GPT22222222222
Gemini 2.522222222222
Gemini 3.122222222222
Claude (thinking)22222222222
4Claude1210111010101010101010
GPT124444444445
Gemini 2.51212121112121112121111
Gemini 3.11210121010101010101010
Claude (thinking)1291091110111010910
5Claude55555555555
GPT54445443445
Gemini 2.556666677766
Gemini 3.1588881010810108
Claude (thinking)54455555555
6Claude1515151214141515151515
GPT1513111111111112111111
Gemini 2.51515151415141414141515
Gemini 3.11516181816161618161816
Claude (thinking)1515141416151414161414
7Claude44344443344
GPT42323233222
Gemini 2.545765777676
Gemini 3.144444444444
Claude (thinking)44443454445
8Claude1915151215121515151515
GPT191010101011101191213
Gemini 2.51919151619161916151819
Gemini 3.11916211621212121212118
Claude (thinking)1914141514141414141415
9Claude2122181818181818181818
GPT21879108979108
Gemini 2.52121202120202121202020
Gemini 3.12119202020192019202020
Claude (thinking)2118181818181819171818
10Claude1915151515181518151515
GPT1913121313111411141113
Gemini 2.51921212421222224222222
Gemini 3.11918202024182018181824
Claude (thinking)1914121114141415141414
11Claude2232323232353232323232
GPT2214131317141816131317
Gemini 2.522272728282825—282825
Gemini 3.12227332424242433272733
Claude (thinking)2222222522251817241828
12Claude1718151515181818181515
GPT1713131311131313111311
Gemini 2.51719231919192319181918
Gemini 3.11722202120202122202120
Claude (thinking)1718141415161512141818
13Claude35455545555
GPT34444544424
Gemini 2.535655666556
Gemini 3.133333333333
Claude (thinking)33653333533
14Claude101010101111109111010
GPT105454444645
Gemini 2.5101010109910109910
Gemini 3.11018181816141816141614
Claude (thinking)1098898899910
15Claude55555555555
GPT54444444444
Gemini 2.554554455445
Gemini 3.155555555555
Claude (thinking)54445444444
16Claude710101010101010101010
GPT71089101199999
Gemini 2.5712101010101010121010
Gemini 3.1710131313101013101016
Claude (thinking)78109999101089
17Claude77777778777
GPT74644444444
Gemini 2.574445454454
Gemini 3.178777788778
Claude (thinking)77766766577
18Claude56565566655
GPT57677777776
Gemini 2.556665655666
Gemini 3.156656666666
Claude (thinking)55555555555
19Claude1415151515151515151515
GPT1410910710101010108
Gemini 2.51416161716161616161616
Gemini 3.11416141515161614151414
Claude (thinking)1413141412141413151214
20Claude1312121212121212121212
GPT13910108101010999
Gemini 2.51315171417151717171515
Gemini 3.11313131314171314141313
Claude (thinking)1312121013131212121211
21Claude1514151414151515141414
GPT1512111312121311111113
Gemini 2.51515161616161615151516
Gemini 3.11516141413141413151413
Claude (thinking)1513121412141412121412
22Claude1312121212121212121212
GPT1397791088889
Gemini 2.51315151515151515151514
Gemini 3.11314141414151515141314
Claude (thinking)1311131113121312141212
23Claude2118181818181818181818
GPT2116131111111113121413
Gemini 2.52121212121222222212121
Gemini 3.12120182020182018191818
Claude (thinking)2118191818181815181818
24Claude1312121212121212121212
GPT1399998108979
Gemini 2.51314141414141414141514
Gemini 3.11314131413141614161314
Claude (thinking)1312121212121212131112
25Claude98888888888
GPT96576657655
Gemini 2.5910101010101010101010
Gemini 3.191010999101010910
Claude (thinking)99899988899
26Claude81010910101010101010
GPT87664676566
Gemini 2.588888888888
Gemini 3.1822227191972219227
Claude (thinking)8888888101179
27Claude15151518181518—151518
GPT1510777786876
Gemini 2.51516131316—13131613—
Gemini 3.11522132413222222222224
Claude (thinking)1512151814141214141214
28Claude1010101010101010101010
GPT106466455455
Gemini 2.51011111113111111111311
Gemini 3.11011111111111111111111
Claude (thinking)1012101011101011101112
29Claude23333323333
GPT22332232232
Gemini 2.523223333223
Gemini 3.12213132131313131313
Claude (thinking)22222222222
30Claude1011121010—10101010—
GPT106655566666
Gemini 2.51010101010101010101010
Gemini 3.11010101018101010101810
Claude (thinking)1010101010101010101010
31Claude65565665655
GPT65654565556
Gemini 2.566666666666
Gemini 3.161012101212121061212
Claude (thinking)67767777767
32Claude99999999989
GPT98777877877
Gemini 2.5910101110111010101011
Gemini 3.191391410101013101010
Claude (thinking)9101091091098910
33Claude1010101010101010101010
GPT104444445444
Gemini 2.51014151212141414151212
Gemini 3.11010111010101110101111
Claude (thinking)10101091091010101010
34Claude1414141414141414141414
GPT14101010991091099
Gemini 2.51416151616161516161616
Gemini 3.11412121211111112121211
Claude (thinking)1412121312111212131412
35Claude88878888878
GPT85555666666
Gemini 2.588888888888
Gemini 3.1815151615151515151515
Claude (thinking)88988888797
36Claude1918181818181818181818
GPT1911131112131212141313
Gemini 2.51919191919201920191919
Gemini 3.11918171718181718171820
Claude (thinking)1918151818181815171617
37Claude2525252424252424222425
GPT251817171701818171818
Gemini 2.52529282829303029302928
Gemini 3.12526262626232426232324
Claude (thinking)2522222222222422242222
38Claude11891010910101098
GPT115666755665
Gemini 2.51111111111111111121211
Gemini 3.1111012106101010101910
Claude (thinking)1181081010891088
39Claude99999999999
GPT98788888989
Gemini 2.599999999999
Gemini 3.198888888888
Claude (thinking)99999999999
Q16: Unique places of stay

Naive (no expert guidance)

PageModelGTr1r2r3r4r5r6r7r8r9r10
1Claude56666666666
GPT57767677777
Gemini 2.555878778778
Gemini 3.156666666666
Claude (thinking)55555555545
2Claude76666666666
GPT77667667666
Gemini 2.576666566566
Gemini 3.176666666666
Claude (thinking)76687777766
3Claude22222222222
GPT22222222222
Gemini 2.522222222222
Gemini 3.122222222222
Claude (thinking)22222222222
4Claude12910881010101098
GPT127766755746
Gemini 2.51217161517151615151517
Gemini 3.11210101010101010101010
Claude (thinking)12910810910810810
5Claude99999999999
GPT97977987888
Gemini 2.59810101081088810
Gemini 3.198888888888
Claude (thinking)99988899899
6Claude71010101010101010109
GPT77967797879
Gemini 2.5788109888899
Gemini 3.178888888888
Claude (thinking)78989898999
7Claude33333333333
GPT33333333333
Gemini 2.533333333333
Gemini 3.133333333333
Claude (thinking)33333333333
8Claude77777777777
GPT79667677778
Gemini 2.578787777887
Gemini 3.177777777777
Claude (thinking)77777767666
9Claude66666666656
GPT66666656566
Gemini 2.566666666666
Gemini 3.165555555555
Claude (thinking)65665556666
10Claude109989999999
GPT108877877887
Gemini 2.51010101010101010101010
Gemini 3.11010101010101111101010
Claude (thinking)1098891089989
11Claude88887888888
GPT8101012121010810108
Gemini 2.588888888888
Gemini 3.188888888888
Claude (thinking)86667766877
12Claude67787887888
GPT69888788988
Gemini 2.567777777777
Gemini 3.166666666666
Claude (thinking)67666776767
13Claude23333333333
GPT22222222222
Gemini 2.523233222332
Gemini 3.122222222222
Claude (thinking)22222222222
14Claude98888888888
GPT95466574667
Gemini 2.599109999109109
Gemini 3.199999998899
Claude (thinking)9108788771088
15Claude44444444444
GPT43443433333
Gemini 2.544444444444
Gemini 3.144444444444
Claude (thinking)44444444444
16Claude76666666666
GPT76667666776
Gemini 2.577777777787
Gemini 3.177877878787
Claude (thinking)77676777677
17Claude66666666666
GPT66655565555
Gemini 2.567667777776
Gemini 3.166666666666
Claude (thinking)66666665546
18Claude44444444444
GPT44444444443
Gemini 2.544444444444
Gemini 3.144444444444
Claude (thinking)44444444444
19Claude98898888888
GPT97676769966
Gemini 2.59109101010101010910
Gemini 3.1910101088108101010
Claude (thinking)97777878868
20Claude88788888878
GPT86676676676
Gemini 2.589888988888
Gemini 3.188888888888
Claude (thinking)87878888888
21Claude98888888888
GPT98888887879
Gemini 2.5911111212121211121111
Gemini 3.1910101010101010101010
Claude (thinking)97888877888
22Claude76666666666
GPT76776778687
Gemini 2.578888888888
Gemini 3.176666666666
Claude (thinking)76557656565
23Claude76666666666
GPT710101010101112101011
Gemini 2.5710101091010109910
Gemini 3.178888887788
Claude (thinking)76777766666
24Claude76666666666
GPT74444444444
Gemini 2.578788888887
Gemini 3.176666666666
Claude (thinking)76656566655
25Claude66666666666
GPT66656656667
Gemini 2.566666666666
Gemini 3.166656566666
Claude (thinking)66666666666
26Claude138888888888
GPT138977770878
Gemini 2.51313131413141414131414
Gemini 3.11310101010101010101010
Claude (thinking)1381010101088101011
27Claude56665566656
GPT54563444445
Gemini 2.558767868678
Gemini 3.156655666666
Claude (thinking)55555565555
28Claude88778778778
GPT84454555454
Gemini 2.588888888888
Gemini 3.187777777777
Claude (thinking)87667777867
29Claude910101010101010101010
GPT9109109999999
Gemini 2.5910111011101010101111
Gemini 3.199999999999
Claude (thinking)911101010101010101010
30Claude1111111011101110101011
GPT116786787877
Gemini 2.51112121212111212121212
Gemini 3.11110101010101010101010
Claude (thinking)1111101110101110121210
31Claude34444444443
GPT33322222222
Gemini 2.533334343334
Gemini 3.133333333333
Claude (thinking)32232323333
32Claude55666565555
GPT56566556665
Gemini 2.557667667666
Gemini 3.155555555555
Claude (thinking)55555555555
33Claude76666666666
GPT74444442244
Gemini 2.5710887101010878
Gemini 3.178888888888
Claude (thinking)74556565554
34Claude78888888888
GPT77787677878
Gemini 2.578888888888
Gemini 3.177777777777
Claude (thinking)79978777888
35Claude109999999998
GPT107787877778
Gemini 2.51010101010101010101010
Gemini 3.11010101010101010101010
Claude (thinking)10101091110111010911
36Claude66665565545
GPT64444643464
Gemini 2.56888889813139
Gemini 3.166666666666
Claude (thinking)65666665554
37Claude810101010101212101010
GPT81496997661212
Gemini 2.5813131413131314141414
Gemini 3.181010101010101010810
Claude (thinking)889981099101110
38Claude10109101010101010910
GPT107112646487
Gemini 2.51010101010101010101010
Gemini 3.11010101010101010101010
Claude (thinking)1012111010101110101010
39Claude55555555555
GPT54655554444
Gemini 2.555555555555
Gemini 3.156666666666
Claude (thinking)55556555655

Guided (with expert guidance)

PageModelGTr1r2r3r4r5r6r7r8r9r10
1Claude56567667777
GPT57778776677
Gemini 2.555565555555
Gemini 3.156656666656
Claude (thinking)56556666656
2Claude76777767—77
GPT78797788788
Gemini 2.577777667666
Gemini 3.177778887777
Claude (thinking)77678777688
3Claude22222222222
GPT22222222222
Gemini 2.522222222222
Gemini 3.122222222222
Claude (thinking)22222222222
4Claude1212121212121212121212
GPT129101110111010111110
Gemini 2.51213151413131413151414
Gemini 3.11212101211121112121212
Claude (thinking)1211131212111212121211
5Claude912121212121012121212
GPT98777767877
Gemini 2.599998989999
Gemini 3.198778888887
Claude (thinking)9109998911988
6Claude712111010101212121212
GPT799109889898
Gemini 2.57991099910999
Gemini 3.178888788888
Claude (thinking)7797981098910
7Claude34444433444
GPT33333333333
Gemini 2.533333333333
Gemini 3.133333333333
Claude (thinking)33333333333
8Claude78888888898
GPT78977978689
Gemini 2.578878787888
Gemini 3.177787777778
Claude (thinking)79998887868
9Claude67788787776
GPT66666556666
Gemini 2.566666666666
Gemini 3.166556656566
Claude (thinking)66686566556
10Claude1012121212141214121212
GPT101110101010910101010
Gemini 2.51010101010101010101010
Gemini 3.11010111110101110101010
Claude (thinking)101012810121214101212
11Claude810121010101010101010
GPT8999991010999
Gemini 2.58889998—998
Gemini 3.188888888888
Claude (thinking)8810108987899
12Claude61010101010101010109
GPT69788889999
Gemini 2.567777777777
Gemini 3.167676777777
Claude (thinking)69787978879
13Claude23333333333
GPT22322322223
Gemini 2.522222222222
Gemini 3.122222222222
Claude (thinking)22222222222
14Claude913121214131212131212
GPT97466666566
Gemini 2.599999999999
Gemini 3.199991010910101010
Claude (thinking)911991111910111011
15Claude45555555555
GPT44434444443
Gemini 2.544444444444
Gemini 3.144444444444
Claude (thinking)44444444444
16Claude76667676666
GPT77667777767
Gemini 2.577777777777
Gemini 3.177666776776
Claude (thinking)77677777777
17Claude67777777777
GPT64555566665
Gemini 2.565556575565
Gemini 3.166565655556
Claude (thinking)66666676667
18Claude44444444444
GPT44444444444
Gemini 2.544444444444
Gemini 3.144444444444
Claude (thinking)44444444444
19Claude910101010101010101010
GPT910999101010101010
Gemini 2.5910101010101010101010
Gemini 3.198788887877
Claude (thinking)98910910898109
20Claude89999999999
GPT87777777777
Gemini 2.588888899888
Gemini 3.187777877777
Claude (thinking)88878988888
21Claude98889899898
GPT98778888888
Gemini 2.5912111111101011121110
Gemini 3.19109101099109910
Claude (thinking)999999891099
22Claude76666666666
GPT77566767676
Gemini 2.577777777777
Gemini 3.177666777666
Claude (thinking)76677567776
23Claude78888888888
GPT711111111111111111111
Gemini 2.579999111111999
Gemini 3.177777777777
Claude (thinking)78788788778
24Claude77776676667
GPT74555554555
Gemini 2.578888888888
Gemini 3.176666666666
Claude (thinking)76566655676
25Claude66766666666
GPT66666666666
Gemini 2.566666666666
Gemini 3.166666666666
Claude (thinking)66666666666
26Claude1311111111111011101112
GPT131110988991089
Gemini 2.51313141413121415151313
Gemini 3.11312121210101212101212
Claude (thinking)1312131214121114121212
27Claude5767777—777
GPT57667766666
Gemini 2.557767—6777—
Gemini 3.156666666666
Claude (thinking)57776878668
28Claude81010101010101010109
GPT84444555454
Gemini 2.588888888888
Gemini 3.186868886668
Claude (thinking)88811119889910
29Claude913131213131213131313
GPT910999999999
Gemini 2.5910101010101010101010
Gemini 3.199999999999
Claude (thinking)91010101010101091010
30Claude1112121313—12121312—
GPT11108999101081110
Gemini 2.51112121212121212121212
Gemini 3.11112101211121210121110
Claude (thinking)1112111211111112111111
31Claude34434343444
GPT32322222222
Gemini 2.533333332323
Gemini 3.133333333333
Claude (thinking)32333333333
32Claude56666666666
GPT56766766676
Gemini 2.557777777677
Gemini 3.156566666666
Claude (thinking)55655665655
33Claude79989889999
GPT75455554444
Gemini 2.578888888888
Gemini 3.176766676677
Claude (thinking)75656586866
34Claude79999988899
GPT78877788988
Gemini 2.578788878888
Gemini 3.176667776767
Claude (thinking)78789789789
35Claude1011121211121212111111
GPT107987889799
Gemini 2.51010101010101010101010
Gemini 3.1101010910101010101010
Claude (thinking)1010101110111111111011
36Claude67667766666
GPT67877767877
Gemini 2.567777910910107
Gemini 3.165556555546
Claude (thinking)66887888886
37Claude812121412121414141412
GPT8101099068889
Gemini 2.5814151514141414141414
Gemini 3.1811111111101010101011
Claude (thinking)810121012121210121212
38Claude1012121312121313131212
GPT10108111099981011
Gemini 2.51010101010101010101010
Gemini 3.11081010108999109
Claude (thinking)1012121110121010121011
39Claude56666666666
GPT54455555555
Gemini 2.555565555656
Gemini 3.156666666666
Claude (thinking)55555666665
Q18: Stay w/ person name

Naive (no expert guidance)

PageModelGTr1r2r3r4r5r6r7r8r9r10
1Claude35444454454
GPT37767677777
Gemini 2.533333333333
Gemini 3.133333333333
Claude (thinking)34333343444
2Claude55565555555
GPT598111010878118
Gemini 2.555555555555
Gemini 3.155555555555
Claude (thinking)54555555545
3Claude11111111111
GPT12022222222
Gemini 2.511111111111
Gemini 3.111111111111
Claude (thinking)11111111111
4Claude1717161718181616161717
GPT1719151817131917161718
Gemini 2.51718181718171817171719
Gemini 3.11715141414151415151515
Claude (thinking)1717161716171517171717
5Claude81199911911999
GPT87777987888
Gemini 2.587888787778
Gemini 3.188888888888
Claude (thinking)88988888899
6Claude64444444444
GPT613911141291011109
Gemini 2.566666666666
Gemini 3.165555555555
Claude (thinking)64543344544
7Claude33333333333
GPT33333333333
Gemini 2.533333333333
Gemini 3.133333333333
Claude (thinking)33333333333
8Claude11111111111
GPT19667677778
Gemini 2.511111111111
Gemini 3.111111111111
Claude (thinking)11111111111
9Claude11122112211
GPT16688858588
Gemini 2.511111111111
Gemini 3.111111111111
Claude (thinking)11111111211
10Claude23323333322
GPT28879077887
Gemini 2.522222222222
Gemini 3.123333333333
Claude (thinking)22222222222
11Claude42222222332
GPT410101212101086106
Gemini 2.544444444444
Gemini 3.143333333333
Claude (thinking)43233322333
12Claude22222222322
GPT22222774181
Gemini 2.522222222222
Gemini 3.122222222222
Claude (thinking)22222222222
13Claude11111111111
GPT12222122222
Gemini 2.511111111111
Gemini 3.111111111111
Claude (thinking)11111111111
14Claude1210101010101010101010
GPT1215181611161014141513
Gemini 2.51212121212121212121212
Gemini 3.11212121212121211111212
Claude (thinking)1212101012101312121112
15Claude44444444444
GPT45443454244
Gemini 2.544444444444
Gemini 3.144444444444
Claude (thinking)44444444445
16Claude55555555556
GPT56767976777
Gemini 2.555555555555
Gemini 3.155555555555
Claude (thinking)55556555555
17Claude34444444444
GPT36656565666
Gemini 2.534334343443
Gemini 3.133333333333
Claude (thinking)33353444334
18Claude11111111111
GPT14444444443
Gemini 2.511111111122
Gemini 3.111111111111
Claude (thinking)11111111111
19Claude54454444444
GPT5766107694114
Gemini 2.555555555555
Gemini 3.154444444444
Claude (thinking)54544534444
20Claude45455555544
GPT46776676878
Gemini 2.543422323344
Gemini 3.144444444344
Claude (thinking)44455455444
21Claude44444444444
GPT488131013109899
Gemini 2.543334343433
Gemini 3.144444444444
Claude (thinking)43444434343
22Claude54444444444
GPT513111212121213111213
Gemini 2.555555555455
Gemini 3.154444444444
Claude (thinking)54465444554
23Claude65555555555
GPT61012121010137121211
Gemini 2.566776675666
Gemini 3.165555555555
Claude (thinking)66566866566
24Claude67655565665
GPT6117111081010101010
Gemini 2.567877777778
Gemini 3.165555555555
Claude (thinking)65656665665
25Claude22222222222
GPT26655654467
Gemini 2.522222222222
Gemini 3.122222222222
Claude (thinking)22222222222
26Claude1818212320232120182122
GPT181518161414110181815
Gemini 2.51818181818181818181818
Gemini 3.11816161616161616161716
Claude (thinking)1818201718161819182118
27Claude23333333333
GPT28131313801313145
Gemini 2.522233232332
Gemini 3.123333333333
Claude (thinking)23322323333
28Claude1214141414141414141413
GPT1213131211121213111310
Gemini 2.51212121212121212121212
Gemini 3.11213131313131311131311
Claude (thinking)1210141313131312141414
29Claude1314131414141414141314
GPT1312111313131110101010
Gemini 2.51313131313131313131313
Gemini 3.11313131313131313131313
Claude (thinking)1313131313131312131313
30Claude1311111111111111111111
GPT131391081010128912
Gemini 2.51313131313131313131313
Gemini 3.11310101111101011101011
Claude (thinking)1311101211111112131212
31Claude910101010101010101010
GPT910101010101010101010
Gemini 2.599999999999
Gemini 3.1910101010101010101010
Claude (thinking)91010101010910101010
32Claude11111111111
GPT197610858900
Gemini 2.511111111111
Gemini 3.111111111111
Claude (thinking)11111111111
33Claude32223332332
GPT34554548555
Gemini 2.533334333343
Gemini 3.132222222222
Claude (thinking)32333333333
34Claude43334333343
GPT45354844464
Gemini 2.544444444444
Gemini 3.144444444444
Claude (thinking)43334444334
35Claude1317151717171715171715
GPT1314131215141414141213
Gemini 2.51314141414141414141414
Gemini 3.11313131313131313131313
Claude (thinking)1318141514151315181314
36Claude46655555555
GPT4128441273468
Gemini 2.544444444444
Gemini 3.143444434434
Claude (thinking)45555565567
37Claude24224334322
GPT216181299176121212
Gemini 2.521111111111
Gemini 3.122222222222
Claude (thinking)24324333343
38Claude1415111415141414151215
GPT141414011121313131312
Gemini 2.51414141414141414141414
Gemini 3.11414141414141414141414
Claude (thinking)1414151213151411121414
39Claude11111111111
GPT13666564644
Gemini 2.511111111111
Gemini 3.111111111111
Claude (thinking)11111111121

Guided (with expert guidance)

PageModelGTr1r2r3r4r5r6r7r8r9r10
1Claude34555555555
GPT34420234024
Gemini 2.533333333333
Gemini 3.133333333333
Claude (thinking)35535434644
2Claude55666666—66
GPT57897778988
Gemini 2.556666556555
Gemini 3.155555555555
Claude (thinking)56765665567
3Claude11111111111
GPT10010000000
Gemini 2.511111111111
Gemini 3.111111111111
Claude (thinking)11111111111
4Claude1721192120212222232021
GPT179101110111510111110
Gemini 2.51716171816161816171818
Gemini 3.11716141615161516161616
Claude (thinking)1722212219212116172021
5Claude812121212121112121212
GPT86777767657
Gemini 2.588888889988
Gemini 3.188118888881
Claude (thinking)8109988911888
6Claude66565566666
GPT65677645297
Gemini 2.566666666666
Gemini 3.165555555555
Claude (thinking)65575765664
7Claude33333333333
GPT33333333333
Gemini 2.533333333333
Gemini 3.133333333333
Claude (thinking)33333333333
8Claude12222232223
GPT10070008800
Gemini 2.511111111111
Gemini 3.111111111111
Claude (thinking)15423111414
9Claude12232222222
GPT14212212222
Gemini 2.511111111111
Gemini 3.111111111111
Claude (thinking)10103110002
10Claude24444444444
GPT2111020821010102
Gemini 2.522222222222
Gemini 3.122333232223
Claude (thinking)23332333324
11Claude43433334333
GPT43466464444
Gemini 2.54445554—554
Gemini 3.144433434444
Claude (thinking)42564333336
12Claude23333333333
GPT20081000001
Gemini 2.522222222222
Gemini 3.122222222222
Claude (thinking)23222323223
13Claude12222222222
GPT12222222223
Gemini 2.511111111111
Gemini 3.111111111111
Claude (thinking)11111111111
14Claude1216151514171516131616
GPT12711121061110101112
Gemini 2.51212121212121212121212
Gemini 3.11212121211121211121112
Claude (thinking)1216161417151618141818
15Claude45555554455
GPT44454343443
Gemini 2.544434443443
Gemini 3.144444444444
Claude (thinking)44545544455
16Claude55555555555
GPT58444467675
Gemini 2.555444444544
Gemini 3.154444444444
Claude (thinking)55445465555
17Claude33445454444
GPT33552443342
Gemini 2.533333343333
Gemini 3.133333333333
Claude (thinking)35333353645
18Claude11222212222
GPT12010021221
Gemini 2.511111111111
Gemini 3.111111111111
Claude (thinking)11111111111
19Claude55555555555
GPT54664546454
Gemini 2.555555555555
Gemini 3.154444444444
Claude (thinking)55545444544
20Claude46666666666
GPT44465655554
Gemini 2.544444444444
Gemini 3.144443443344
Claude (thinking)45554644554
21Claude44444444444
GPT40494004404
Gemini 2.544444444444
Gemini 3.144444444444
Claude (thinking)44545444555
22Claude56665765667
GPT594100466765
Gemini 2.555555555555
Gemini 3.154444555444
Claude (thinking)56455646585
23Claude65555565665
GPT61101141166676
Gemini 2.566666666666
Gemini 3.165554555555
Claude (thinking)66676666667
24Claude67667778776
GPT66474444444
Gemini 2.566666666666
Gemini 3.165555565655
Claude (thinking)66667678765
25Claude22322222222
GPT23342333332
Gemini 2.522222222222
Gemini 3.122222222222
Claude (thinking)22222222212
26Claude1822212220202119212219
GPT18161998161718101517
Gemini 2.51818181818181818181818
Gemini 3.11818181817161818171818
Claude (thinking)1819181919231518222216
27Claude2433343—433
GPT27102100000410
Gemini 2.523333—3333—
Gemini 3.123333333333
Claude (thinking)24543454544
28Claude1213151514171417141415
GPT1288888888810
Gemini 2.51212121212121212121212
Gemini 3.11211121112121211111112
Claude (thinking)1213131811151415161415
29Claude1313131313131413131313
GPT131211910111110101010
Gemini 2.51313131313131313131313
Gemini 3.11313131313131313131313
Claude (thinking)1313131313131311131313
30Claude1312121313—12131312—
GPT13108999101081110
Gemini 2.51313131313131313131313
Gemini 3.11313121313131311131311
Claude (thinking)1313121211131212141313
31Claude91010101110101081010
GPT98089886000
Gemini 2.599999999999
Gemini 3.191081088810988
Claude (thinking)910101110910910109
32Claude11111111111
GPT16000070000
Gemini 2.511111111111
Gemini 3.111111111111
Claude (thinking)11211111111
33Claude34444344444
GPT34444000044
Gemini 2.532333222333
Gemini 3.133322333233
Claude (thinking)34334455444
34Claude44444444444
GPT44645464654
Gemini 2.544344434444
Gemini 3.144444444444
Claude (thinking)44346344444
35Claude1313151515151515151515
GPT131115141281313131213
Gemini 2.51313141313141313131413
Gemini 3.11313131313131313131313
Claude (thinking)1313141314121214171313
36Claude47667766886
GPT47877767877
Gemini 2.544444434334
Gemini 3.143334333334
Claude (thinking)45866888884
37Claude23344444444
GPT2010000000109
Gemini 2.522222222222
Gemini 3.122222222222
Claude (thinking)22000034040
38Claude1413151513131515151413
GPT1415101114999121011
Gemini 2.51414141414141414141414
Gemini 3.11412131412121414141414
Claude (thinking)1412161511121414151413
39Claude11111111111
GPT14405050550
Gemini 2.511111111111
Gemini 3.111111111111
Claude (thinking)11111111111
Q19: Bracket total

Naive (no expert guidance)

PageModelGTr1r2r3r4r5r6r7r8r9r10
1Claude56555554564
GPT54343444334
Gemini 2.554444344334
Gemini 3.155554545555
Claude (thinking)55435445465
2Claude45555555555
GPT42232223222
Gemini 2.543333333333
Gemini 3.145555545555
Claude (thinking)44455344444
3Claude11111111111
GPT12122222222
Gemini 2.511111111111
Gemini 3.111111111111
Claude (thinking)11111111111
4Claude04444444444
GPT00000000000
Gemini 2.502432343335
Gemini 3.103111313333
Claude (thinking)03243333522
5Claude00000000000
GPT00000000000
Gemini 2.502111212221
Gemini 3.100000000000
Claude (thinking)00000210000
6Claude45555545555
GPT43444444354
Gemini 2.544443444433
Gemini 3.144444454444
Claude (thinking)45685556676
7Claude22222222222
GPT22222222222
Gemini 2.522222222222
Gemini 3.122222222222
Claude (thinking)22222222222
8Claude68101081081081010
GPT64444444444
Gemini 2.56767612667912
Gemini 3.166688886886
Claude (thinking)6981088881299
9Claude24343434433
GPT22222222222
Gemini 2.522222222222
Gemini 3.122222222222
Claude (thinking)23242343323
10Claude1012121212121212121212
GPT106878868887
Gemini 2.51010991010101010911
Gemini 3.11011111111111010111111
Claude (thinking)1011111416141212111210
11Claude11108108101010101010
GPT1110101010101010101210
Gemini 2.51111121111111111111112
Gemini 3.111999910991099
Claude (thinking)1188888881088
12Claude66676776677
GPT66766665677
Gemini 2.566666666666
Gemini 3.165556665556
Claude (thinking)66677776757
13Claude11111111111
GPT11111111111
Gemini 2.512122111221
Gemini 3.111111111111
Claude (thinking)11111111111
14Claude00000000000
GPT00000000000
Gemini 2.502532215151
Gemini 3.101111112211
Claude (thinking)00000000000
15Claude00000000000
GPT00000000000
Gemini 2.500000010101
Gemini 3.100000000000
Claude (thinking)00000000000
16Claude35554555544
GPT34334333433
Gemini 2.533535333533
Gemini 3.133333333333
Claude (thinking)35435573433
17Claude12222222222
GPT11111111111
Gemini 2.511111212111
Gemini 3.111111111111
Claude (thinking)12121222221
18Claude22222222222
GPT22222122122
Gemini 2.522222222222
Gemini 3.122222222222
Claude (thinking)22222222222
19Claude36666666666
GPT33333333333
Gemini 2.534442424442
Gemini 3.133333333333
Claude (thinking)34655666556
20Claude56676666666
GPT54454444544
Gemini 2.555555555555
Gemini 3.155555555555
Claude (thinking)54556565556
21Claude66666666666
GPT66566666666
Gemini 2.566666666666
Gemini 3.166666666666
Claude (thinking)67777676667
22Claude24444444444
GPT22222222222
Gemini 2.525344545533
Gemini 3.122222222222
Claude (thinking)26565665665
23Claude68888888888
GPT66444466464
Gemini 2.568997897778
Gemini 3.165555555555
Claude (thinking)6897710810888
24Claude46666666666
GPT42222322222
Gemini 2.543333334333
Gemini 3.144444444444
Claude (thinking)46566655666
25Claude24333343333
GPT22222222222
Gemini 2.522222211222
Gemini 3.122222222222
Claude (thinking)27323233772
26Claude12222222222
GPT11111210111
Gemini 2.512222222222
Gemini 3.112211111221
Claude (thinking)12222222222
27Claude7108108888888
GPT74666666666
Gemini 2.576777676776
Gemini 3.177777777777
Claude (thinking)79109109111210910
28Claude14444444444
GPT11111111111
Gemini 2.512112211211
Gemini 3.113333331331
Claude (thinking)13442342444
29Claude00000000000
GPT00000000000
Gemini 2.501010011100
Gemini 3.100000000000
Claude (thinking)00000000000
30Claude33444334444
GPT33333333333
Gemini 2.533333333333
Gemini 3.133333333333
Claude (thinking)33333333333
31Claude44444446444
GPT44446442444
Gemini 2.544444444444
Gemini 3.144444444444
Claude (thinking)44554454444
32Claude24444444444
GPT22222222222
Gemini 2.522222222222
Gemini 3.122222424222
Claude (thinking)22442424324
33Claude36666656656
GPT33333323233
Gemini 2.535552555424
Gemini 3.133333333333
Claude (thinking)35666657555
34Claude66667666776
GPT64443454343
Gemini 2.568878888888
Gemini 3.166666666666
Claude (thinking)67877877877
35Claude23333333334
GPT20100011102
Gemini 2.522323322233
Gemini 3.122222222222
Claude (thinking)23232223322
36Claude8101010881088108
GPT86666666646
Gemini 2.5814141414141514101012
Gemini 3.188888888888
Claude (thinking)81012101212129101012
37Claude1318141418141418141414
GPT1310101010121010101010
Gemini 2.51314141314141413131313
Gemini 3.11314141414141414141114
Claude (thinking)1316121218141412131414
38Claude7108101010101010810
GPT77666756676
Gemini 2.577777777777
Gemini 3.176666566666
Claude (thinking)778889117786
39Claude12222222222
GPT11111111111
Gemini 2.511111111111
Gemini 3.111111111111
Claude (thinking)12111211211

Guided (with expert guidance)

PageModelGTr1r2r3r4r5r6r7r8r9r10
1Claude56667666666
GPT54443333443
Gemini 2.554444444444
Gemini 3.155555555555
Claude (thinking)55645555555
2Claude45655556—56
GPT44434444445
Gemini 2.548484554858
Gemini 3.144454444444
Claude (thinking)44555455554
3Claude11111111111
GPT11222122122
Gemini 2.511111111111
Gemini 3.111111111111
Claude (thinking)11111111111
4Claude02222222222
GPT00000000000
Gemini 2.504654454655
Gemini 3.103003333030
Claude (thinking)02334333300
5Claude00000000000
GPT00000000000
Gemini 2.509997953399
Gemini 3.100000000000
Claude (thinking)00000000000
6Claude46666566666
GPT44444455455
Gemini 2.545567666655
Gemini 3.145555455555
Claude (thinking)47668848666
7Claude22222322222
GPT22222222222
Gemini 2.522222222222
Gemini 3.122222222222
Claude (thinking)22222222222
8Claude610101010101010101010
GPT66645664466
Gemini 2.56910797971059
Gemini 3.165656666665
Claude (thinking)61010118968889
9Claude23333333333
GPT23323222233
Gemini 2.522222222222
Gemini 3.122222222222
Claude (thinking)23433324342
10Claude1014141212141414141412
GPT109109998108108
Gemini 2.51010109109991099
Gemini 3.110910101091099910
Claude (thinking)1014131410121211121210
11Claude111010101010810101010
GPT1110101010111110111010
Gemini 2.511141411111111—111111
Gemini 3.11111101010101010111110
Claude (thinking)1187888887810
12Claude67676777777
GPT67777768666
Gemini 2.566666666666
Gemini 3.166666666666
Claude (thinking)65669885558
13Claude11111111111
GPT11111111111
Gemini 2.511111111111
Gemini 3.111111111111
Claude (thinking)11111111111
14Claude00000000000
GPT00000000000
Gemini 2.505551356116
Gemini 3.101111111111
Claude (thinking)00000000000
15Claude00000000000
GPT00000000000
Gemini 2.501011101111
Gemini 3.100000000000
Claude (thinking)00000000000
16Claude34444444444
GPT34444445444
Gemini 2.535655566555
Gemini 3.133333333333
Claude (thinking)34434354433
17Claude12222222222
GPT11111111111
Gemini 2.512222222222
Gemini 3.112111111112
Claude (thinking)11122222212
18Claude22222222222
GPT22221221212
Gemini 2.523333333333
Gemini 3.122222222222
Claude (thinking)22222222222
19Claude36666655666
GPT33443333334
Gemini 2.534434434443
Gemini 3.133333333333
Claude (thinking)35564465566
20Claude56666666666
GPT55444454444
Gemini 2.554555466544
Gemini 3.155555555555
Claude (thinking)54545546554
21Claude68888888788
GPT66666665667
Gemini 2.567666887778
Gemini 3.166656666666
Claude (thinking)65567686667
22Claude24444444444
GPT22232222222
Gemini 2.524243332343
Gemini 3.122222222222
Claude (thinking)25246444544
23Claude68877777777
GPT64444646646
Gemini 2.569889888899
Gemini 3.165665656566
Claude (thinking)6968881081069
24Claude46666666666
GPT43222222222
Gemini 2.544555554545
Gemini 3.144444444444
Claude (thinking)45554646545
25Claude23333333333
GPT22222223222
Gemini 2.523232233332
Gemini 3.122222222222
Claude (thinking)22322222223
26Claude12212211121
GPT11112211212
Gemini 2.512332532222
Gemini 3.111122321212
Claude (thinking)11221211121
27Claude7101010101010—101010
GPT77767779866
Gemini 2.57109810—89109—
Gemini 3.177777777777
Claude (thinking)79128810810899
28Claude12222222222
GPT11111111111
Gemini 2.511112111121
Gemini 3.112123332221
Claude (thinking)14223222222
29Claude00000000000
GPT000000000010
Gemini 2.500000000000
Gemini 3.100000000000
Claude (thinking)00000000000
30Claude34434—4333—
GPT33334343343
Gemini 2.533333333333
Gemini 3.133333333333
Claude (thinking)33333333333
31Claude46646664666
GPT44444444444
Gemini 2.544444444444
Gemini 3.144444444444
Claude (thinking)44454554444
32Claude24444444444
GPT22222222222
Gemini 2.522232322223
Gemini 3.122222222222
Claude (thinking)22222223222
33Claude36666566666
GPT34333434443
Gemini 2.535355555355
Gemini 3.133333333333
Claude (thinking)36556566656
34Claude68787888888
GPT66566677667
Gemini 2.568777877877
Gemini 3.165556665656
Claude (thinking)66767677657
35Claude23333333443
GPT21101111111
Gemini 2.523333333333
Gemini 3.122222222222
Claude (thinking)22332222422
36Claude8101010888881010
GPT86566466676
Gemini 2.58111111119129121211
Gemini 3.188887888878
Claude (thinking)8881081086888
37Claude1318181816161818161818
GPT131110101001010101010
Gemini 2.51314141414131314131413
Gemini 3.11312121212121213121211
Claude (thinking)1312161814141416161413
38Claude712121212101212121212
GPT79677777656
Gemini 2.577777777777
Gemini 3.176666666666
Claude (thinking)78887999878
39Claude11221212221
GPT11111111111
Gemini 2.511111111111
Gemini 3.111111111111
Claude (thinking)11111111111