Possibile problema nei test in VM HW6 (RISOLTO)

Question

i test nella VM a quanto pare passano tutti ma "non tutti" e non riesco a capirne il motivo, ora mi mostro i log:

=========================== short test summary info ============================
PASSED test_01.py==Test==test_data_01__1__20____LFR____NFF____FNR___
PASSED test_01.py==Test==test_data_02__2__4____NNNNNRRFNNFRLNNNNNNNNNNNNNNNNNNNNNNNNNNNNNNNNNNNNNNNNFLRFNNNNNNNNNNN____NNNLNNNNNNNNLFFNNNNNNNNNNNNNNNNNNNNNNNNNNNNNNNNNNNNNNFNNRNNNNNNNNNNN____NNFNNNFRRFRLNNNNNNNNNNNNNNNNNNNNNNNNNNNNNNNNNNNNNNNNNNNNNNNNNNNNNNNN____NRRNNRNNNNNNFLNNNNNNNNNNNNNNNNNNNNNNNNNNNNNNNNNNNNNNNRNNRNNNNNNNNNNN____NNNLNNNNNNNNLRNNNNNNNNNNNNNNNNNNNNNNNNNNNNNNNNNNNNNNNFNNNNNNNNNNNNNN____FNNRNNNNNNNNNNNNNNNNNNNNNNNNNNNNNNNNNNNNNNNNNNNNNNNNNFNNNNNNNNNNNNNN____FNFNNNNNNNNNNNNNNNNNNRLNRRFNNNNNLLFLNLRNNNNNFFNNRRNFNFNNFNNRLNFFRNNN____LNLNNNNNNNNNNNNNNNNLRNNNNNRFNNNLLNNNNNFLNNNNNNNNNNFNFRNNRNLFNNNNNFNN____FNRNNNNNFNNNNNNNNNNRNNNRFRNFFNNLNFRRFNNLFNFNNNRNFNNNRFNNNFNNRRFFLNRN____LNLNNNNNNNNNNNNNFNLNFRNNNFNNRNNNFNNNNLFNRNNNLLNNNFNNRRNNFFNNLNNRRNFL____LNRLNNNNFLNRFFRNRFFNFNNNNNRNFRLNLNNNNNLNFFNNNNNNNRRNRNNNLNNLLRFNNNNN____FNNLNNNNNNNNNNNNLNNNFNNNNNRNRFNNRNNNNNFNNNNNNNNNNNRNRRNNLLNLNFNLRNRN____RFNRFNNNNNNNNFNNFFNNRNNNNNNNNFNNFNNNNNNNLRNNNNNNNNLNRNNNFFNNNNRFNNNN____NRNNLRNNNNNNRFNLFFNNRNNNNFFNFRFNFNNNNLFNRLLNFNNNNFLNLLNNNLNNNNNNNRRN____NNNNNLNNNLLFFNFFNNRNNNLNLFNRRNNNNNFNLRNRRNNNNRFNNFNNLLNNNLLNRLNFLFRL____NNLLLNNNNNNNNRFNNNNNNNLNFNNLNNNFNNFFRNNLNNRNNNNFFNNNFNNNNNFLNLLLNNNL____NNNNLFRNNNNRFNNNNNNNRRNNNNNLNNNRFLNNNFNLNNNFNLNNNNNNLNNNLNNNLNNNLFRN____NNNNNNLLNRLLNNNNNNNNNLNNFFNNNNNNNLNRRNNNNNNNNRFRRNLNNNNNNNNNNRFNNNNN____NNNNNNNNNNNNNNNNNNNNNNNNNNNNNNNNNNNNNNNNNNLRRNNNNRNNNNNNNNNNNNNNNNNN____NNNNNNNNNNNNNNNNNNNNNNNNNNNNNNNNNNNNNNNNNNFNFFNNLNNFFNNNNNNNNNNNNNNN____NNNNNNNNNNNNNNNNNNNNNNNNNNNNNNNNNNNNNNNNNNFNNNRNRNLLNNNNNNNNNNNNNNNN____NNNNNNNNNNNNNNNNNNNNNNNNNNNNNNNNNNNNNNNNNNNLFLNNNRFNNNNNNNNNNNNNNNNN____NNNNNNNNNNNNNNNNNNNNNNNNNNNNNNNNNNNNNNNNNNNNNFFLRLNNNNNNNNNNNNNNNNNN___
PASSED test_01.py==Test==test_data_03__3__44____FRRFN____NFLNF____RFLRL____LLRLR____FFNFF___
PASSED test_01.py==Test==test_data_04__4__32____LLFRFNRFRL____NLFRFFNLRN____LNNNFLLRNF____LRRLLNRFLL____LNRNNRNLRN____NRLFNRNFLF____FFRNRNRLNF___
PASSED test_01.py==Test==test_data_05__5__80____FNNLFNFR____FNFNRFRN____RNFFFLLL____LRLLLNFR____NNFFFLFF___
PASSED test_01.py==Test==test_data_06__6__40____LNLLFLRFLLRRNLNN____LNRNFLNFLRNLLLRR____LNNLRRRFRNLLLNLN____LNNNNNFLNNRFLLRR____NRNNFNFRNLLRNFNR____FFLFRLLFRRFFLNLN____NFNNNNLRNLFLLFNN____LRFNNLNFFNNRLLFF____FNLNRRFNRLFNRRNF____LFLFNLLNNFNNRFNN____FFNRFFNLNFLRLRLL____FLRRLNLNFFNFNFNN___
PASSED test_01.py==Test==test_data_07__7__10____NLRLNFFNLFFNFRNNNNFNFLRRRNRLFLNNFRFFLFRNRFFLNFRNNR____FFNFRLFFLRRFFRRLFNLNLRRNFNFNNRRNRRNFNNRLNFRNFNRNFF____FRRFNLNFFNNLLRNFLFLFLNRRLNLNFRFRLFNLLRFFRLNNRRRNNR____RFFRNFRLNRNLLFLRRFNFLNFLRNRFLFFRNNLNNLNFFNLNNNNFFR____RRFLFLLFLNRFLRNRLRFFRFLLLLRNLLLRFFLLNRLNLRLRFNFNNL____FLLLNNRLFFFFNRLFNLFRFLLFFLFLRNFRLLRNFFLNLRFNLLLRLN____FLLNFFNNFLRFLRNFFNFLNNLRRLFLNFRLFFFLNNLNRRFFFRFNRF____NRLNRLRNRLRFFFLLRLRNLLRFRLFNFRNFRNLRNNRLFFNLNFFNFR____FLRFFLLFFNLRNFLRNNFFRFNFNNLFLLLFRFFLNLFRFFFLRFRRRR____NLRLLLFRNLLLNFLRLFLLRFRRNLNNLRRFLLLRFLLNLNNLNNLRRF____NFLNNLFLRRNLLNFFLLFFLNLNLLNNFFFLRNLFFRRFFLLNFRRNNN____FNRRNLLRFNNLRNFFFRNNRNFLNLLRFFRNFRFRNNRRLNLFRRLFNN____RRNLRNRRNFNFFNNNNLLRNFNNFLLFNFFFNNFNNNRFFRLRNFFNFL____FNRLNFLNNFRFRNFLNNNNRLRRLNLRNLFLLLFFRFFLNRRNNRRFLR____RLLLFFRFLNNFNFFNLRFLLNLNRFLNRRNRNNRLFLRFNFRFNNFRLR____RLRLRRFRFLRNRNFFNRLNNLNFRRLRFLFLFRRNFNNFRRLRFRLLLR____FFFNFLRFRFLFLLRLRLRRLNLLLNRLFLFNRFRFLRFFFNNRRFLLFN____FRFFLRNLNNLRNFRRNLNRNLLLFLFNLNFNNRNLLFFNFRNFNLRLLF____FLFNLLLNLLNFLRRFLNLFNRNRNFNFFLNLNNLRNNRRRFFRFLRRLL____RLFRLLRRRRLLRNRFLFFNLFRRLLRFFRFRRFFRFNNRLRLNLRNNFL____FFLFFNRRRFFNNNLRRLNLNNLRRFLFFNFNRRNRRLNLFLNLRRNLLL____RRFFNFFLRFLFRLNRNFNLNNRNRLFRLRNFNLRRFNRLLFNRNLFFFN____NNFRRRRFLRNRLRRLLNRLNRNFRNRNLRNLFLNNLLFNNNFRFNNFRN____NRFFFLRLFRLRLFFNFNRNNFLNNNLNFRNLLFLLNLRLLNRFLFLNNF____FLRNNLLRRRNRFRFNRRLFFFRFNLFNNNLLLNNFFRLLLRRLRLLLFR____FNLRLNFLRRRLFLRFFLFLFNFFLNFLNLRFNNRRNRLLNFNNLFLNFR____RRNRLLRFRLFRFNNFRRRLLRLFLRFLNLLNRNLNRNFNRLFFRRRFNR____FLNLLLFLFNRFRRFNRNLLRFLLRLRFNFNNLRLNRNFFRRNLNRLRNL____RNFRRNFLRLRRRRRRFNLLFLLNLRLFFLFLFRLFRRRFLLRNLRFFFR____NNRFFRRLLLLRNLLLLFNNNRRRFFFNRFLRFLLNLLNRFRNLLNNFFL____FRLFNNRLRLFNRLNRNRFFRLRNLLFNFNNRRFLRLFLLNLFFRNRLFN____FRRFRRNFFLNLNFRFFRFFRRRFNNNLRNRRFFRFNNRNRRNRRFLNNN____RFNRRLRRFRLRLLRFFRNRNNFFRRLFNLLLNNRLRNNNRLFRFRRLLR____NLNFRFRNNNLNRNNNLNFLFFNFLFFLNFFNLFFFLNNLNRFRFFNRNF____NNNRFNFFRLFNNLLRRNRFRFFFLNNRFRNNNLNLFFFLNRRRFLFFLL____NNRFLNLNNLFNLFFLRRRLNLNNNRNRFFNFFFLNFRFLNFLNRLFFNF____LFFFLNFRLRRLNNFRNNFFRRRNNNRRFFFRLRRLNNNRNFRNFFNFLF____RNLNLRLLFNFRLNFLNNLLNFNFNRLRLLFRNRLLRLRNRRFRNFFRFN____LRFNFLRLNRRRLRRNFFRFFRFNNRFLFNLFNLNRFFFFRLRLFNRRRN____NNNLFLNRFFRLNRFRNRFFRNNNNNRRLLLFLNFRNRNLFFNLRFLLNF____RFFFFFFLFRRFFRLRNRLLRFNLNNLNLNLNFRLLFRFFNRLFRNNNNL____RRLRRRLRNRNLLLRNFFNNNLLFLRFNNFRNLNLLFRLNNRRNFLLRRL____FFNRFNFFRFNFNNRFLNFNNLFLLFLFRFRRRLNFNNLRRFFLRLFNNN____RRRFFFRFRRNLFRLNNRNFFLLFFFLNLRLRNRNRRNRFLNRLRFNLFR____NFFRFFRNRRNLNLLRNLNFNFRLNFFRFLFRFFFFRRLFLFRNNFFLNN____NFLFNNRNNFNFFRLNLFRLNNFFRLLFLNRFFRNNRRRLFNLRRFFNLF____RFNLNLRNFLFRFNNLNLRRLRNNRFLFNLLRFFRFLFFNRFNNNLLFNR____FLFRLFRRFNFFRNFRLRFRRFRLLLNRRNRFNNFLLLNNLFRFNRFFFL____LFRLFLFRFRLNFRNFRRRNNNNRLLLNNRNLRNNNLRFFNRFRRRNRLR____FRFFFLLRLLNLRRRNRRFFFFNNNFNRNRFNFRNNFRNNRNLLFRFRRL____NFLRFFNFNRLFFNLNFRRFLFLNRNNNLNFFLFNRNRFNFFLFFNNFFL____FFNNFNLRRRFFFFFNLRFFRFRNFLRNNNRLRNNLLFRLNFRFRLLNNR____NFFFLRLRNLFRLLLRNRLLRRFFFLNLNLFLFFFLRRLRFNLLLNFRRL____NFLRNNFLFFNRNFLRNRRFFRRRFRFLFNLFLNNRRRLLRLRRFNRNLR____RLFLFNNRRNLFFRNLLNRFRFFNFNFNLLRNNRFRRFLLLRNFNLLLFF____RNRLLNNLRLRNRRFNRNFLNRFRLNNRFFLRFFLFNRFLRNLLNRRNFF____FFRNNRNFNRFNNFNRNLRFLRNLRNFLNRLNNRLNLRFRRLRNFFRNFL____FNFNNRLFFFLFFFRRNRRFLRLRNRFRFFRNNLRRLFLNLRRRNNNFNF____RFFLNFNLNNLLRRRNRLFLLRRRNRLRRFLNRFNRLRRNFNRNFFLRLL____NFLFRLNFNNRLFNRFLLRLRRNRNLLNLFNFRRNLRLRFNRFFLFFNNN____LNFRFFLNFLRFFRLLRNRFFFRNLNFNRFNFRNFLFRRNRRNRLRLRNR____NNLNNRRRLNFNRRNLNFFRLLFFFNNLNRLFFRRLNNFNFRFLFRRFNR____RFNFRLFFLNLNLFRLLRRRNRLLRRNRNNRLRLRLNRLLLRRNNFLFNL____NRFFNLRLLLRLLFNNLFNNNNLFFRRLNLNLFRRLRRRNLLLLNFNFRL____FLRLFRFLNLFFLNLLFNRRRLFRRLNLFLFLFLFNNLNFFRFRFFRLNN____FRNRFFNRLFFLNNNRRLFFRRFRFLFFFLRNRLRNNRLLFFNRFFNNFL____LLFRNLLFFRLLRLLRNRNNFFLFNNFLNRLRLLFLFNLRNRFRNNRNRN____RFNFFLNFFRRRRRLFFLNNFRFNNNLNLLLRNNNLFFLLLNRRLLLRRR____NRLLRFFRRRRLRNFNLNNLLFFNFNNNNFFRNFFNFNFFRLRFNLRNRF____RLNLRFLNRNLLLLRRRLRLLNRFRNFFRLRLNLRRNNFLNFLNRFLNNN____RNFFNLRRNRFNFLLLNLRFLNLRLRNFLNLNRRRFNNLLLRRRFFRRRF____RNRLLFRFFLLRRRFLRFLRFNRNFRRFFNFNFRFFLFNLLLNRLNLFLL____NNNLNNLNFNFFLRNFNRFNRFFFNLFLLNFNNNLFNLLLNRRLFNRRLR____RRNRNFRNFNRLFNFLLRRRNNRNNNFNLRRFNFNLNLLNNLLFNNRFRR____FFNLLLFRFNLRRLFNRNRLRFLRRRFLFLRLLFFRFNRFRLFRNFRRNF____FRNFRRLNNLLRFNFNFLFRNNFRLNLRLRLLLNFRLFLLRNLLRFNLRL____LFLLNRLFFRLRLLLFRFNNNLFFFLRFFLFNFNNFNLFFFRRLLNRLLF___
PASSED test_01.py==Test==test_data_08__8__220____LFN____RLL___
PASSED test_01.py==Test==test_data_09__9__100____NNRNFNNN____NFRNNLLN____RFFNNLLN____RFRFRNLL____FLRLFNRF____NLLNRFNF____NRNRFFNN____NNNLRLNN___
PASSED test_01.py==Test==test_data_10__10__60____FNLLFFLLNNLNRNFFNRN____NLRLNRFLRLLNNLRFNNL____RRLNRFFLFLNFNNLLRNL____LLLRNLRFRRLNFNFFFFR____RNLNRLFRNFNFNNLNFNF____RNFRNRLRNNRFLNNLFRN____NLLNFLNRRFNNRRRRRLN____NLFRFRNLLNRNNFRRRNN____LRFNNFFRFRNRLFRFNLF____LRLFRNRRFLFRNNRFLRL___
PASSED test_01.py==Test==test_intricacy
PASSED test_01.py==Test==test_no_globals_or_mutable_args
PASSED test_01.py==Test==test_untampered_types
================ 13 passed, 10 deselected, 1 warning in 10.34s =================

come vedete, passa ogni test ma comunque ho una valutazione di 19 passati normali con 6 passati segreti e non 23 normali con 10 segreti, come mai? E' sbagliato l'algoritmo? c'e' un problema nella macchina?

*nella decodifica usavo delle stringhe e lavoravo su quelle, provando a cambiare approccio con le liste passa tutti i test*

Answer 1

I test totali sono 23, di cui 13 noti e 10 segreti, tu passi tutti quelli noti "13 passed" e solo 6 segreti per un totale di 19 test. Verifica che il tuo algoritmo comprenda qualsiasi casistica e che non valga solo per le immagini date.

I test segreti non sono mostrati nel log, sono i "10 deselected".

Comments

Ma i test noti non dovrebbero comprendere ogni casistica? Così come faccio a capire cosa ho sbagliato?

---

Questo è quello che riporta il regolamento del corso: "oltre ai test pubblicati, per ottenere il punteggio definitivo agli esercizi verranno applicati alcuni test aggiuntivi "segreti" che servono per assicurarsi che la soluzione non sia cablata sui test noti, ma che l'implementazione sia corretta in un numero significativo di casi."

---

La cosa è che io non ho cablato i casi, io applico l'algoritmo come dice la traccia, e funziona su 19 casi, non capisco perché gli ultimi 4 non vadano, sicuramente c'è una casistica che non ho pensato, ma vorrei sapere quel caso, così capisco se è un problema di chiavi, di eccezione o di file

---

Magari il professore può darti un riscontro, dato che può vedere il tuo codice e i test segreti che non superi.

Answer 2

Non gestisci bene il 'J' sull'ultimo carattere

Comments

salve professore, ho provato a cambiare nel test 3 nel file da decodificare l'ultimo carattere da D a J cosi da poter verificare se la 'J' venga gestita bene o meno

ma quando avvio il programma, riesce a scrivermi (solo in questo caso) 'Jigital', quindi funziona anche nel caso di J all'ultimo carattere.

Intendeva questo quando ha scritto che non gestisco bene il carattere J?

---

Typo, intendevo non gestisci bene la chiave 'F' applicata all'ultimo carattere