You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
First of all, my apologies since I am not sure if this is the appropriate forum to consult this. I am trying to compute some metrics over my rankings using the trec_eval and compatibility measures from TREC 2020 Health Misinfo. However, I have some doubts:
Is there a way to compute the individual NDCG for correctness? Since when generating the derived-qrels it only outputs a file called binary.useful-correct.
Is there a way to compute the combined harmful and helpful compatibility measures, as used in the overview paper? Since the gen-derived-qrels only outputs harmful.only and helpful.only files.
I would appreciate any help.
Best,
Marcos
The text was updated successfully, but these errors were encountered:
Hi,
First of all, my apologies since I am not sure if this is the appropriate forum to consult this. I am trying to compute some metrics over my rankings using the trec_eval and compatibility measures from TREC 2020 Health Misinfo. However, I have some doubts:
Is there a way to compute the individual NDCG for correctness? Since when generating the derived-qrels it only outputs a file called binary.useful-correct.
Is there a way to compute the combined harmful and helpful compatibility measures, as used in the overview paper? Since the gen-derived-qrels only outputs harmful.only and helpful.only files.
I would appreciate any help.
Best,
Marcos
The text was updated successfully, but these errors were encountered: