Compare rule sets difficulty for human players

Note: there is also a command-line interface for this tool, scripts/analyze-transcripts-mwh.sh; it has more modes and options than available via the web interface. Documentation is here.

---

Choose one or several experiment plans from the list below. All rule sets included in those plans will be compared.

2PG/adve.test_1(22 players, 40 episodes) 2PG/adve.test_2a(7 players, 45 episodes) 2PG/adve.test_2b(6 players, 29 episodes) 2PG/coop.test_1(5 players, 7 episodes) 2PG/coop.test_2(12 players, 29 episodes) 2PG/test_adve(1 players, 1 episodes) ad/adve.immovable(3 players, 3 episodes) ad/coop(2 players, 4 episodes) ad/coop.immovable(1 players, 1 episodes) ad/trialFixed(3 players, 7 episodes) APP/vm/image_test_01(2 players, 4 episodes) Bot(4 players, 17 episodes) BotTest_1(4 players, 22 episodes) Bot_2(7 players, 32 episodes) Bot_3(74 players, 965 episodes) Bot_3_ph16(66 players, 978 episodes) Bot_3_ph4(69 players, 955 episodes) Bot_4(64 players, 805 episodes) FDCL/basic(232 players, 2357 episodes) FDCL/trnsfr_1(9 players, 45 episodes) FDCL/trnsfr_1/tools(1 players, 6 episodes) P:2PG/adve.test_1:bot/pseudo-10(1 players, 1 episodes) P:FDCL/basic:bot-assist/pseudo-10(6 players, 7 episodes) P:TRSFR/CMPND_1:bot-assist/pseudo-10(1 players, 1 episodes) pilot04(1 players, 3 episodes) pilot06(2 players, 6 episodes) pk(5 players, 5 episodes) pk/2pilot_cntxt(4 players, 5 episodes) pk/adve.3ules-bot-assist(6 players, 14 episodes) pk/adve.good3ules-bot-assist(1 players, 2 episodes) pk/cntxt2024JUN25(1 players, 3 episodes) pk/colorVshape(2 players, 2 episodes) pk/content_B(1 players, 2 episodes) pk/dev2024APR19(1 players, 1 episodes) pk/dev2024MAY27(1 players, 6 episodes) pk/movie(4 players, 6 episodes) pk/pilot_cntxt(1 players, 4 episodes) pk/position_A(14 players, 41 episodes) pk/position_A/one_shape_one_color(1 players, 6 episodes) pk/prod2024JUN15(1 players, 7 episodes) pk/xcolorVshape(1 players, 2 episodes) R:/home/vmenkov/test/test-01.txt:FDCL/basic(5 players, 8 episodes) R:APP/combine/comp_B:APP/APP2-some-feedback(1 players, 2 episodes) R:APP/OCT26/OCT26-10:APP/APP-max-feedback(1 players, 1 episodes) R:APP/OCT26/OCT26-11:APP/APP-max-feedback(1 players, 1 episodes) R:APP/OCT26/OCT26-1:APP/APP-no-feedback(1 players, 1 episodes) R:APP/OCT26/OCT26-2:APP/APP-no-feedback(1 players, 2 episodes) R:APP/OCT26/OCT26-8:APP/APP-max-feedback(1 players, 2 episodes) R:APP/OCT26/OCT26-Zach-1:APP/APP-max-feedback(2 players, 2 episodes) R:APP/pk/alternateShape2Bucket_color2Bucket:APP/APP-no-feedback(1 players, 5 episodes) R:APP/pk/colOrd_nrnr:APP/APP2-some-feedback(1 players, 1 episodes) R:APP/pk/colOrd_RBYK:APP/APP-max-feedback(1 players, 1 episodes) R:APP/pk/history_A:APP/APP-no-feedback(1 players, 1 episodes) R:APP/pk/history_A:APP/APP2-more-feedback(1 players, 1 episodes) R:APP/pk/history_A:APP/APP2-some-feedback(1 players, 1 episodes) R:APP/pk/noRule:APP/APP-no-feedback(1 players, 2 episodes) R:APP/pk/objects_A:APP/APP-no-feedback(1 players, 5 episodes) R:CGS/1_sm.txt:APP/APP-no-feedback(4 players, 4 episodes) R:CGS/3_bltr.txt:APP/APP-no-feedback(1 players, 5 episodes) R:FDCL/basic/colOrdL1_BRKY:FDCL/basic(4 players, 9 episodes) R:FDCL/basic/colOrdL1_KBYR:APP/APP-no-feedback(1 players, 1 episodes) RU/JF/adve.botrules1(9 players, 24 episodes) RU/JF/tht/exp1(47 players, 205 episodes) RU/JF/tht/exp2(10 players, 44 episodes) RU/JF/tht/exp2a(6 players, 36 episodes) RU/JF/tht/exp2a_rev1(9 players, 50 episodes) RU/JF/tht/exp2_rev1(8 players, 39 episodes) RU/JF/tht/exp4(22 players, 43 episodes) RU/JF/tht/exp4a(12 players, 24 episodes) RU/JF/tht/exp4a_rev1(1 players, 2 episodes) RU/JF/tht/exp4_rev1(1 players, 2 episodes) RU/JF/transfer2(21 players, 114 episodes) RU/JF/transfer2_patch(5 players, 23 episodes) RU/JF/TransferSS(393 players, 6038 episodes) RU/JF/TransferSS2(267 players, 3812 episodes) RU/JF/TransferSS2/buckOrd(1 players, 3 episodes) RU/JF/transfer_sala(35 players, 177 episodes) RU/JF/transfer_sala2(122 players, 654 episodes) RU/JF/Trap(17 players, 17 episodes) TEST(2 players, 4 episodes) TEST/cmpnd_3(4 players, 8 episodes) TEST/cmpnd_4(1 players, 2 episodes) TEST/cw-bot-assist(2 players, 5 episodes) TRSFR/CMPND-1(13 players, 46 episodes) TRSFR/CMPND_1(10 players, 38 episodes) TRSFR/CMPND_2(74 players, 999 episodes) TRSFR/CMPND_3(86 players, 1102 episodes) TRSFR/CMPND_4(64 players, 944 episodes) vm/adve.colorVshape(65 players, 214 episodes) vm/adve.colorVshape-bot(4 players, 25 episodes) vm/adve.colorVshape-bot-assist(4 players, 9 episodes) vm/colorVshape(19 players, 23 episodes) vm/colorVshape-bot-assist(55 players, 174 episodes) vm/composite-05(2 players, 2 episodes) vm/coop.colorVshape(24 players, 108 episodes) vm/coop.colorVshape-bot(2 players, 2 episodes) vm/exp4(1 players, 2 episodes) vm/pilot06_doubling(3 players, 8 episodes) vmColorTest(1 players, 1 episodes)

Stage 1: Transcript processing parameters Learning attainment criterion (enter one): consecutive error-free moves, or R ≥ Default mStar = (You can also enter the value Infinity) Stage 2: data interpretation parameters for M-W Naive: For each rule sets, only include "naive" players (those who played this rule set as their first rule set) Every: Consider each (rule set + preceding set) combination as a separate experience to be ranked. (That is, the R1 data from R1:R2:R3, R2:R1:R3, and R2:R3:R1 are viewed as belonging to three distinct experiences, "R1", "R2:R1", and "R2:R3:R1") Ignore: When viewing a rule set's series, ignore preceding rule sets. (In other words, the R1 data from R1:R2:R3, R2:R1:R3, and R2:R3:R1 are merged, viewed as the same "R1 experience"). Check to use mDagger instead of mStar Compare rule sets (only click once)