{ "eval_loss": 96.93744744925664, "eval_classification_loss": 0.0, "eval_structure_loss": 0.0, "eval_event_structure_loss": 96.93744744925664, "eval_count_loss": 1.0276662892308728e-09, "step": 2748, "epoch": 11, "eval_event_type_strict_micro_precision": 1.0, "eval_event_type_strict_micro_recall": 0.9866071428571429, "eval_event_type_strict_micro_f1": 0.9932584269662922, "eval_event_type_strict_macro_precision": 1.0, "eval_event_type_strict_macro_recall": 0.9921641439656972, "eval_event_type_strict_macro_f1": 0.9958242469451635, "eval_event_type_strict_support": 896, "eval_event_type_strict_classification_report": "label precision recall f1 support\n----------------------------------------------------------------------------------\nartifactexistence.damagedestroy.damage 1.0000 1.0000 1.0000 7\nartifactexistence.damagedestroy.destroy 1.0000 1.0000 1.0000 13\nartifactexistence.damagedestroy.n/a 1.0000 1.0000 1.0000 8\nconflict.attack.airstrikemissilestrike 1.0000 1.0000 1.0000 4\nconflict.attack.biologicalchemicalpois.. 1.0000 1.0000 1.0000 3\nconflict.attack.bombing 1.0000 0.8571 0.9231 7\nconflict.attack.firearmattack 1.0000 1.0000 1.0000 2\nconflict.attack.invade 1.0000 1.0000 1.0000 1\nconflict.attack.n/a 1.0000 0.9714 0.9855 35\nconflict.attack.selfdirectedbattle 1.0000 0.9756 0.9877 41\nconflict.attack.setfire 1.0000 1.0000 1.0000 1\nconflict.attack.stabbing 1.0000 1.0000 1.0000 1\nconflict.attack.stealrobhijack 1.0000 1.0000 1.0000 5\nconflict.demonstrate.marchprotestpolit.. 1.0000 1.0000 1.0000 2\nconflict.yield.n/a 1.0000 1.0000 1.0000 7\nconflict.yield.retreat 1.0000 1.0000 1.0000 3\nconflict.yield.surrender 1.0000 1.0000 1.0000 5\ncontact.collaborate.correspondence 1.0000 1.0000 1.0000 7\ncontact.collaborate.n/a 1.0000 1.0000 1.0000 7\ncontact.commandorder.broadcast 1.0000 1.0000 1.0000 6\ncontact.commandorder.correspondence 1.0000 1.0000 1.0000 1\ncontact.commandorder.meet 1.0000 1.0000 1.0000 3\ncontact.commandorder.n/a 1.0000 1.0000 1.0000 4\ncontact.commitmentpromiseexpressintent.. 1.0000 1.0000 1.0000 5\ncontact.commitmentpromiseexpressintent.. 1.0000 1.0000 1.0000 6\ncontact.commitmentpromiseexpressintent.. 1.0000 1.0000 1.0000 12\ncontact.commitmentpromiseexpressintent.. 1.0000 1.0000 1.0000 2\ncontact.discussion.correspondence 1.0000 1.0000 1.0000 11\ncontact.discussion.meet 1.0000 1.0000 1.0000 17\ncontact.discussion.n/a 1.0000 1.0000 1.0000 4\ncontact.funeralvigil.meet 1.0000 1.0000 1.0000 1\ncontact.funeralvigil.n/a 1.0000 1.0000 1.0000 1\ncontact.mediastatement.broadcast 1.0000 1.0000 1.0000 6\ncontact.mediastatement.n/a 1.0000 1.0000 1.0000 3\ncontact.negotiate.correspondence 1.0000 1.0000 1.0000 2\ncontact.negotiate.meet 1.0000 1.0000 1.0000 8\ncontact.negotiate.n/a 1.0000 1.0000 1.0000 1\ncontact.prevarication.broadcast 1.0000 1.0000 1.0000 8\ncontact.prevarication.correspondence 1.0000 1.0000 1.0000 9\ncontact.prevarication.meet 1.0000 1.0000 1.0000 10\ncontact.prevarication.n/a 1.0000 1.0000 1.0000 4\ncontact.publicstatementinperson.broadc.. 1.0000 1.0000 1.0000 6\ncontact.publicstatementinperson.n/a 1.0000 1.0000 1.0000 5\ncontact.requestadvise.broadcast 1.0000 1.0000 1.0000 12\ncontact.requestadvise.correspondence 1.0000 1.0000 1.0000 10\ncontact.requestadvise.meet 1.0000 1.0000 1.0000 7\ncontact.requestadvise.n/a 1.0000 1.0000 1.0000 6\ncontact.threatencoerce.broadcast 1.0000 1.0000 1.0000 4\ncontact.threatencoerce.correspondence 1.0000 1.0000 1.0000 5\ncontact.threatencoerce.meet 1.0000 1.0000 1.0000 3\ncontact.threatencoerce.n/a 1.0000 1.0000 1.0000 6\ndisaster.accidentcrash.accidentcrash 1.0000 1.0000 1.0000 3\ndisaster.fireexplosion.fireexplosion 1.0000 1.0000 1.0000 3\ngovernment.agreements.acceptagreementc.. 1.0000 1.0000 1.0000 6\ngovernment.agreements.n/a 1.0000 1.0000 1.0000 3\ngovernment.agreements.violateagreement 1.0000 1.0000 1.0000 2\ngovernment.formation.n/a 1.0000 1.0000 1.0000 1\ngovernment.formation.startgpe 1.0000 1.0000 1.0000 1\ngovernment.legislate.legislate 1.0000 1.0000 1.0000 7\ngovernment.spy.spy 1.0000 0.9167 0.9565 12\ngovernment.vote.castvote 1.0000 1.0000 1.0000 3\ngovernment.vote.n/a 1.0000 1.0000 1.0000 4\ngovernment.vote.violationspreventvote 1.0000 1.0000 1.0000 2\ninspection.sensoryobserve.inspectpeopl.. 1.0000 1.0000 1.0000 6\ninspection.sensoryobserve.monitorelect.. 1.0000 1.0000 1.0000 3\ninspection.sensoryobserve.n/a 1.0000 1.0000 1.0000 1\ninspection.sensoryobserve.physicalinve.. 1.0000 1.0000 1.0000 4\njustice.arrestjaildetain.arrestjaildet.. 1.0000 1.0000 1.0000 8\njustice.initiatejudicialprocess.charge.. 1.0000 1.0000 1.0000 6\njustice.initiatejudicialprocess.n/a 1.0000 1.0000 1.0000 4\njustice.initiatejudicialprocess.trialh.. 1.0000 1.0000 1.0000 8\njustice.investigate.investigatecrime 1.0000 1.0000 1.0000 8\njustice.investigate.n/a 1.0000 1.0000 1.0000 2\njustice.judicialconsequences.convict 1.0000 1.0000 1.0000 8\njustice.judicialconsequences.execute 1.0000 1.0000 1.0000 5\njustice.judicialconsequences.extradite 1.0000 1.0000 1.0000 2\njustice.judicialconsequences.n/a 1.0000 1.0000 1.0000 6\nlife.die.deathcausedbyviolentevents 1.0000 0.9767 0.9882 43\nlife.die.n/a 1.0000 1.0000 1.0000 20\nlife.die.nonviolentdeath 1.0000 1.0000 1.0000 10\nlife.injure.illnessdegradationhungerth.. 1.0000 0.8750 0.9333 8\nlife.injure.illnessdegradationphysical 1.0000 1.0000 1.0000 5\nlife.injure.injurycausedbyviolentevents 1.0000 0.9615 0.9804 26\nlife.injure.n/a 1.0000 0.9600 0.9796 25\nmanufacture.artifact.build 1.0000 1.0000 1.0000 3\nmanufacture.artifact.createintellectua.. 1.0000 1.0000 1.0000 1\nmanufacture.artifact.createmanufacture 1.0000 1.0000 1.0000 4\nmanufacture.artifact.n/a 1.0000 1.0000 1.0000 6\nmovement.transportartifact.bringcarryu.. 1.0000 1.0000 1.0000 3\nmovement.transportartifact.dispersesep.. 1.0000 1.0000 1.0000 1\nmovement.transportartifact.fall 1.0000 1.0000 1.0000 1\nmovement.transportartifact.grantentry 1.0000 1.0000 1.0000 2\nmovement.transportartifact.hide 1.0000 1.0000 1.0000 2\nmovement.transportartifact.n/a 1.0000 1.0000 1.0000 8\nmovement.transportartifact.nonviolentt.. 1.0000 1.0000 1.0000 1\nmovement.transportartifact.prevententry 1.0000 1.0000 1.0000 3\nmovement.transportartifact.preventexit 1.0000 1.0000 1.0000 5\nmovement.transportartifact.receiveimport 1.0000 1.0000 1.0000 1\nmovement.transportartifact.sendsupplye.. 1.0000 0.8000 0.8889 5\nmovement.transportartifact.smuggleextr.. 1.0000 1.0000 1.0000 3\nmovement.transportperson.dispersesepar.. 1.0000 1.0000 1.0000 3\nmovement.transportperson.evacuationres.. 1.0000 1.0000 1.0000 9\nmovement.transportperson.grantentryasy.. 1.0000 1.0000 1.0000 4\nmovement.transportperson.n/a 1.0000 0.8889 0.9412 9\nmovement.transportperson.prevententry 1.0000 1.0000 1.0000 5\nmovement.transportperson.preventexit 1.0000 1.0000 1.0000 9\nmovement.transportperson.selfmotion 1.0000 1.0000 1.0000 8\nmovement.transportperson.smuggleextract 1.0000 1.0000 1.0000 2\npersonnel.elect.n/a 1.0000 1.0000 1.0000 3\npersonnel.elect.winelection 1.0000 1.0000 1.0000 2\npersonnel.endposition.firinglayoff 1.0000 1.0000 1.0000 12\npersonnel.endposition.n/a 1.0000 1.0000 1.0000 8\npersonnel.endposition.quitretire 1.0000 1.0000 1.0000 3\npersonnel.startposition.hiring 1.0000 1.0000 1.0000 10\npersonnel.startposition.n/a 1.0000 1.0000 1.0000 4\ntransaction.transaction.embargosanction 1.0000 1.0000 1.0000 16\ntransaction.transaction.giftgrantprovi.. 1.0000 1.0000 1.0000 6\ntransaction.transaction.n/a 1.0000 1.0000 1.0000 4\ntransaction.transaction.transfercontrol 1.0000 0.8571 0.9231 7\ntransaction.transfermoney.borrowlend 1.0000 1.0000 1.0000 4\ntransaction.transfermoney.embargosanct.. 1.0000 1.0000 1.0000 9\ntransaction.transfermoney.giftgrantpro.. 1.0000 1.0000 1.0000 8\ntransaction.transfermoney.n/a 1.0000 0.9412 0.9697 17\ntransaction.transfermoney.payforservice 1.0000 1.0000 1.0000 13\ntransaction.transfermoney.purchase 1.0000 1.0000 1.0000 14\ntransaction.transferownership.borrowlend 1.0000 1.0000 1.0000 8\ntransaction.transferownership.embargos.. 1.0000 1.0000 1.0000 14\ntransaction.transferownership.giftgran.. 1.0000 1.0000 1.0000 7\ntransaction.transferownership.n/a 1.0000 1.0000 1.0000 14\ntransaction.transferownership.purchase 1.0000 1.0000 1.0000 13\n----------------------------------------------------------------------------------\nmicro avg 1.0000 0.9866 0.9933 896\nmacro avg 1.0000 0.9922 0.9958 896", "eval_event_type_relaxed_micro_precision": 1.0, "eval_event_type_relaxed_micro_recall": 0.9866071428571429, "eval_event_type_relaxed_micro_f1": 0.9932584269662922, "eval_event_type_relaxed_macro_precision": 1.0, "eval_event_type_relaxed_macro_recall": 0.9921641439656972, "eval_event_type_relaxed_macro_f1": 0.9958242469451635, "eval_event_type_relaxed_support": 896, "eval_event_type_relaxed_classification_report": "label precision recall f1 support\n----------------------------------------------------------------------------------\nartifactexistence.damagedestroy.damage 1.0000 1.0000 1.0000 7\nartifactexistence.damagedestroy.destroy 1.0000 1.0000 1.0000 13\nartifactexistence.damagedestroy.n/a 1.0000 1.0000 1.0000 8\nconflict.attack.airstrikemissilestrike 1.0000 1.0000 1.0000 4\nconflict.attack.biologicalchemicalpois.. 1.0000 1.0000 1.0000 3\nconflict.attack.bombing 1.0000 0.8571 0.9231 7\nconflict.attack.firearmattack 1.0000 1.0000 1.0000 2\nconflict.attack.invade 1.0000 1.0000 1.0000 1\nconflict.attack.n/a 1.0000 0.9714 0.9855 35\nconflict.attack.selfdirectedbattle 1.0000 0.9756 0.9877 41\nconflict.attack.setfire 1.0000 1.0000 1.0000 1\nconflict.attack.stabbing 1.0000 1.0000 1.0000 1\nconflict.attack.stealrobhijack 1.0000 1.0000 1.0000 5\nconflict.demonstrate.marchprotestpolit.. 1.0000 1.0000 1.0000 2\nconflict.yield.n/a 1.0000 1.0000 1.0000 7\nconflict.yield.retreat 1.0000 1.0000 1.0000 3\nconflict.yield.surrender 1.0000 1.0000 1.0000 5\ncontact.collaborate.correspondence 1.0000 1.0000 1.0000 7\ncontact.collaborate.n/a 1.0000 1.0000 1.0000 7\ncontact.commandorder.broadcast 1.0000 1.0000 1.0000 6\ncontact.commandorder.correspondence 1.0000 1.0000 1.0000 1\ncontact.commandorder.meet 1.0000 1.0000 1.0000 3\ncontact.commandorder.n/a 1.0000 1.0000 1.0000 4\ncontact.commitmentpromiseexpressintent.. 1.0000 1.0000 1.0000 5\ncontact.commitmentpromiseexpressintent.. 1.0000 1.0000 1.0000 6\ncontact.commitmentpromiseexpressintent.. 1.0000 1.0000 1.0000 12\ncontact.commitmentpromiseexpressintent.. 1.0000 1.0000 1.0000 2\ncontact.discussion.correspondence 1.0000 1.0000 1.0000 11\ncontact.discussion.meet 1.0000 1.0000 1.0000 17\ncontact.discussion.n/a 1.0000 1.0000 1.0000 4\ncontact.funeralvigil.meet 1.0000 1.0000 1.0000 1\ncontact.funeralvigil.n/a 1.0000 1.0000 1.0000 1\ncontact.mediastatement.broadcast 1.0000 1.0000 1.0000 6\ncontact.mediastatement.n/a 1.0000 1.0000 1.0000 3\ncontact.negotiate.correspondence 1.0000 1.0000 1.0000 2\ncontact.negotiate.meet 1.0000 1.0000 1.0000 8\ncontact.negotiate.n/a 1.0000 1.0000 1.0000 1\ncontact.prevarication.broadcast 1.0000 1.0000 1.0000 8\ncontact.prevarication.correspondence 1.0000 1.0000 1.0000 9\ncontact.prevarication.meet 1.0000 1.0000 1.0000 10\ncontact.prevarication.n/a 1.0000 1.0000 1.0000 4\ncontact.publicstatementinperson.broadc.. 1.0000 1.0000 1.0000 6\ncontact.publicstatementinperson.n/a 1.0000 1.0000 1.0000 5\ncontact.requestadvise.broadcast 1.0000 1.0000 1.0000 12\ncontact.requestadvise.correspondence 1.0000 1.0000 1.0000 10\ncontact.requestadvise.meet 1.0000 1.0000 1.0000 7\ncontact.requestadvise.n/a 1.0000 1.0000 1.0000 6\ncontact.threatencoerce.broadcast 1.0000 1.0000 1.0000 4\ncontact.threatencoerce.correspondence 1.0000 1.0000 1.0000 5\ncontact.threatencoerce.meet 1.0000 1.0000 1.0000 3\ncontact.threatencoerce.n/a 1.0000 1.0000 1.0000 6\ndisaster.accidentcrash.accidentcrash 1.0000 1.0000 1.0000 3\ndisaster.fireexplosion.fireexplosion 1.0000 1.0000 1.0000 3\ngovernment.agreements.acceptagreementc.. 1.0000 1.0000 1.0000 6\ngovernment.agreements.n/a 1.0000 1.0000 1.0000 3\ngovernment.agreements.violateagreement 1.0000 1.0000 1.0000 2\ngovernment.formation.n/a 1.0000 1.0000 1.0000 1\ngovernment.formation.startgpe 1.0000 1.0000 1.0000 1\ngovernment.legislate.legislate 1.0000 1.0000 1.0000 7\ngovernment.spy.spy 1.0000 0.9167 0.9565 12\ngovernment.vote.castvote 1.0000 1.0000 1.0000 3\ngovernment.vote.n/a 1.0000 1.0000 1.0000 4\ngovernment.vote.violationspreventvote 1.0000 1.0000 1.0000 2\ninspection.sensoryobserve.inspectpeopl.. 1.0000 1.0000 1.0000 6\ninspection.sensoryobserve.monitorelect.. 1.0000 1.0000 1.0000 3\ninspection.sensoryobserve.n/a 1.0000 1.0000 1.0000 1\ninspection.sensoryobserve.physicalinve.. 1.0000 1.0000 1.0000 4\njustice.arrestjaildetain.arrestjaildet.. 1.0000 1.0000 1.0000 8\njustice.initiatejudicialprocess.charge.. 1.0000 1.0000 1.0000 6\njustice.initiatejudicialprocess.n/a 1.0000 1.0000 1.0000 4\njustice.initiatejudicialprocess.trialh.. 1.0000 1.0000 1.0000 8\njustice.investigate.investigatecrime 1.0000 1.0000 1.0000 8\njustice.investigate.n/a 1.0000 1.0000 1.0000 2\njustice.judicialconsequences.convict 1.0000 1.0000 1.0000 8\njustice.judicialconsequences.execute 1.0000 1.0000 1.0000 5\njustice.judicialconsequences.extradite 1.0000 1.0000 1.0000 2\njustice.judicialconsequences.n/a 1.0000 1.0000 1.0000 6\nlife.die.deathcausedbyviolentevents 1.0000 0.9767 0.9882 43\nlife.die.n/a 1.0000 1.0000 1.0000 20\nlife.die.nonviolentdeath 1.0000 1.0000 1.0000 10\nlife.injure.illnessdegradationhungerth.. 1.0000 0.8750 0.9333 8\nlife.injure.illnessdegradationphysical 1.0000 1.0000 1.0000 5\nlife.injure.injurycausedbyviolentevents 1.0000 0.9615 0.9804 26\nlife.injure.n/a 1.0000 0.9600 0.9796 25\nmanufacture.artifact.build 1.0000 1.0000 1.0000 3\nmanufacture.artifact.createintellectua.. 1.0000 1.0000 1.0000 1\nmanufacture.artifact.createmanufacture 1.0000 1.0000 1.0000 4\nmanufacture.artifact.n/a 1.0000 1.0000 1.0000 6\nmovement.transportartifact.bringcarryu.. 1.0000 1.0000 1.0000 3\nmovement.transportartifact.dispersesep.. 1.0000 1.0000 1.0000 1\nmovement.transportartifact.fall 1.0000 1.0000 1.0000 1\nmovement.transportartifact.grantentry 1.0000 1.0000 1.0000 2\nmovement.transportartifact.hide 1.0000 1.0000 1.0000 2\nmovement.transportartifact.n/a 1.0000 1.0000 1.0000 8\nmovement.transportartifact.nonviolentt.. 1.0000 1.0000 1.0000 1\nmovement.transportartifact.prevententry 1.0000 1.0000 1.0000 3\nmovement.transportartifact.preventexit 1.0000 1.0000 1.0000 5\nmovement.transportartifact.receiveimport 1.0000 1.0000 1.0000 1\nmovement.transportartifact.sendsupplye.. 1.0000 0.8000 0.8889 5\nmovement.transportartifact.smuggleextr.. 1.0000 1.0000 1.0000 3\nmovement.transportperson.dispersesepar.. 1.0000 1.0000 1.0000 3\nmovement.transportperson.evacuationres.. 1.0000 1.0000 1.0000 9\nmovement.transportperson.grantentryasy.. 1.0000 1.0000 1.0000 4\nmovement.transportperson.n/a 1.0000 0.8889 0.9412 9\nmovement.transportperson.prevententry 1.0000 1.0000 1.0000 5\nmovement.transportperson.preventexit 1.0000 1.0000 1.0000 9\nmovement.transportperson.selfmotion 1.0000 1.0000 1.0000 8\nmovement.transportperson.smuggleextract 1.0000 1.0000 1.0000 2\npersonnel.elect.n/a 1.0000 1.0000 1.0000 3\npersonnel.elect.winelection 1.0000 1.0000 1.0000 2\npersonnel.endposition.firinglayoff 1.0000 1.0000 1.0000 12\npersonnel.endposition.n/a 1.0000 1.0000 1.0000 8\npersonnel.endposition.quitretire 1.0000 1.0000 1.0000 3\npersonnel.startposition.hiring 1.0000 1.0000 1.0000 10\npersonnel.startposition.n/a 1.0000 1.0000 1.0000 4\ntransaction.transaction.embargosanction 1.0000 1.0000 1.0000 16\ntransaction.transaction.giftgrantprovi.. 1.0000 1.0000 1.0000 6\ntransaction.transaction.n/a 1.0000 1.0000 1.0000 4\ntransaction.transaction.transfercontrol 1.0000 0.8571 0.9231 7\ntransaction.transfermoney.borrowlend 1.0000 1.0000 1.0000 4\ntransaction.transfermoney.embargosanct.. 1.0000 1.0000 1.0000 9\ntransaction.transfermoney.giftgrantpro.. 1.0000 1.0000 1.0000 8\ntransaction.transfermoney.n/a 1.0000 0.9412 0.9697 17\ntransaction.transfermoney.payforservice 1.0000 1.0000 1.0000 13\ntransaction.transfermoney.purchase 1.0000 1.0000 1.0000 14\ntransaction.transferownership.borrowlend 1.0000 1.0000 1.0000 8\ntransaction.transferownership.embargos.. 1.0000 1.0000 1.0000 14\ntransaction.transferownership.giftgran.. 1.0000 1.0000 1.0000 7\ntransaction.transferownership.n/a 1.0000 1.0000 1.0000 14\ntransaction.transferownership.purchase 1.0000 1.0000 1.0000 13\n----------------------------------------------------------------------------------\nmicro avg 1.0000 0.9866 0.9933 896\nmacro avg 1.0000 0.9922 0.9958 896", "eval_event_trigger_strict_micro_precision": 0.9083969465648855, "eval_event_trigger_strict_micro_recall": 0.9296875, "eval_event_trigger_strict_micro_f1": 0.918918918918919, "eval_event_trigger_strict_macro_precision": 0.9264096393724368, "eval_event_trigger_strict_macro_recall": 0.9412856905879057, "eval_event_trigger_strict_macro_f1": 0.9325378683330265, "eval_event_trigger_strict_support": 896, "eval_event_trigger_strict_classification_report": "label precision recall f1 support\n----------------------------------------------------------------------------------\nartifactexistence.damagedestroy.damage 1.0000 1.0000 1.0000 7\nartifactexistence.damagedestroy.destroy 0.8462 0.8462 0.8462 13\nartifactexistence.damagedestroy.n/a 1.0000 1.0000 1.0000 8\nconflict.attack.airstrikemissilestrike 1.0000 1.0000 1.0000 4\nconflict.attack.biologicalchemicalpois.. 0.6667 0.6667 0.6667 3\nconflict.attack.bombing 0.6667 0.5714 0.6154 7\nconflict.attack.firearmattack 0.5000 0.5000 0.5000 2\nconflict.attack.invade 1.0000 1.0000 1.0000 1\nconflict.attack.n/a 0.7895 0.8571 0.8219 35\nconflict.attack.selfdirectedbattle 0.8537 0.8537 0.8537 41\nconflict.attack.setfire 1.0000 1.0000 1.0000 1\nconflict.attack.stabbing 1.0000 1.0000 1.0000 1\nconflict.attack.stealrobhijack 1.0000 1.0000 1.0000 5\nconflict.demonstrate.marchprotestpolit.. 0.5000 0.5000 0.5000 2\nconflict.yield.n/a 0.7778 1.0000 0.8750 7\nconflict.yield.retreat 1.0000 1.0000 1.0000 3\nconflict.yield.surrender 1.0000 1.0000 1.0000 5\ncontact.collaborate.correspondence 1.0000 1.0000 1.0000 7\ncontact.collaborate.n/a 1.0000 1.0000 1.0000 7\ncontact.commandorder.broadcast 1.0000 1.0000 1.0000 6\ncontact.commandorder.correspondence 1.0000 1.0000 1.0000 1\ncontact.commandorder.meet 1.0000 1.0000 1.0000 3\ncontact.commandorder.n/a 1.0000 1.0000 1.0000 4\ncontact.commitmentpromiseexpressintent.. 1.0000 1.0000 1.0000 5\ncontact.commitmentpromiseexpressintent.. 1.0000 1.0000 1.0000 6\ncontact.commitmentpromiseexpressintent.. 0.8571 1.0000 0.9231 12\ncontact.commitmentpromiseexpressintent.. 1.0000 1.0000 1.0000 2\ncontact.discussion.correspondence 1.0000 1.0000 1.0000 11\ncontact.discussion.meet 0.8889 0.9412 0.9143 17\ncontact.discussion.n/a 0.8000 1.0000 0.8889 4\ncontact.funeralvigil.meet 1.0000 1.0000 1.0000 1\ncontact.funeralvigil.n/a 1.0000 1.0000 1.0000 1\ncontact.mediastatement.broadcast 1.0000 1.0000 1.0000 6\ncontact.mediastatement.n/a 1.0000 1.0000 1.0000 3\ncontact.negotiate.correspondence 1.0000 1.0000 1.0000 2\ncontact.negotiate.meet 1.0000 1.0000 1.0000 8\ncontact.negotiate.n/a 1.0000 1.0000 1.0000 1\ncontact.prevarication.broadcast 1.0000 1.0000 1.0000 8\ncontact.prevarication.correspondence 1.0000 1.0000 1.0000 9\ncontact.prevarication.meet 1.0000 1.0000 1.0000 10\ncontact.prevarication.n/a 1.0000 1.0000 1.0000 4\ncontact.publicstatementinperson.broadc.. 1.0000 1.0000 1.0000 6\ncontact.publicstatementinperson.n/a 1.0000 1.0000 1.0000 5\ncontact.requestadvise.broadcast 0.9167 0.9167 0.9167 12\ncontact.requestadvise.correspondence 1.0000 1.0000 1.0000 10\ncontact.requestadvise.meet 1.0000 1.0000 1.0000 7\ncontact.requestadvise.n/a 1.0000 1.0000 1.0000 6\ncontact.threatencoerce.broadcast 1.0000 1.0000 1.0000 4\ncontact.threatencoerce.correspondence 0.8333 1.0000 0.9091 5\ncontact.threatencoerce.meet 1.0000 1.0000 1.0000 3\ncontact.threatencoerce.n/a 1.0000 1.0000 1.0000 6\ndisaster.accidentcrash.accidentcrash 1.0000 1.0000 1.0000 3\ndisaster.fireexplosion.fireexplosion 0.7500 1.0000 0.8571 3\ngovernment.agreements.acceptagreementc.. 1.0000 1.0000 1.0000 6\ngovernment.agreements.n/a 1.0000 1.0000 1.0000 3\ngovernment.agreements.violateagreement 1.0000 1.0000 1.0000 2\ngovernment.formation.n/a 1.0000 1.0000 1.0000 1\ngovernment.formation.startgpe 1.0000 1.0000 1.0000 1\ngovernment.legislate.legislate 0.8571 0.8571 0.8571 7\ngovernment.spy.spy 0.9091 0.8333 0.8696 12\ngovernment.vote.castvote 0.5000 0.6667 0.5714 3\ngovernment.vote.n/a 0.8000 1.0000 0.8889 4\ngovernment.vote.violationspreventvote 0.5000 0.5000 0.5000 2\ninspection.sensoryobserve.inspectpeopl.. 1.0000 1.0000 1.0000 6\ninspection.sensoryobserve.monitorelect.. 1.0000 1.0000 1.0000 3\ninspection.sensoryobserve.n/a 1.0000 1.0000 1.0000 1\ninspection.sensoryobserve.physicalinve.. 0.6667 1.0000 0.8000 4\njustice.arrestjaildetain.arrestjaildet.. 0.7778 0.8750 0.8235 8\njustice.initiatejudicialprocess.charge.. 0.8333 0.8333 0.8333 6\njustice.initiatejudicialprocess.n/a 1.0000 1.0000 1.0000 4\njustice.initiatejudicialprocess.trialh.. 0.8750 0.8750 0.8750 8\njustice.investigate.investigatecrime 1.0000 1.0000 1.0000 8\njustice.investigate.n/a 1.0000 1.0000 1.0000 2\njustice.judicialconsequences.convict 1.0000 1.0000 1.0000 8\njustice.judicialconsequences.execute 1.0000 1.0000 1.0000 5\njustice.judicialconsequences.extradite 1.0000 1.0000 1.0000 2\njustice.judicialconsequences.n/a 0.8333 0.8333 0.8333 6\nlife.die.deathcausedbyviolentevents 0.9545 0.9767 0.9655 43\nlife.die.n/a 0.8571 0.9000 0.8780 20\nlife.die.nonviolentdeath 1.0000 1.0000 1.0000 10\nlife.injure.illnessdegradationhungerth.. 0.8571 0.7500 0.8000 8\nlife.injure.illnessdegradationphysical 0.8000 0.8000 0.8000 5\nlife.injure.injurycausedbyviolentevents 0.7037 0.7308 0.7170 26\nlife.injure.n/a 0.8800 0.8800 0.8800 25\nmanufacture.artifact.build 1.0000 1.0000 1.0000 3\nmanufacture.artifact.createintellectua.. 1.0000 1.0000 1.0000 1\nmanufacture.artifact.createmanufacture 1.0000 1.0000 1.0000 4\nmanufacture.artifact.n/a 1.0000 1.0000 1.0000 6\nmovement.transportartifact.bringcarryu.. 1.0000 1.0000 1.0000 3\nmovement.transportartifact.dispersesep.. 1.0000 1.0000 1.0000 1\nmovement.transportartifact.fall 0.0000 0.0000 0.0000 1\nmovement.transportartifact.grantentry 1.0000 1.0000 1.0000 2\nmovement.transportartifact.hide 1.0000 1.0000 1.0000 2\nmovement.transportartifact.n/a 0.8750 0.8750 0.8750 8\nmovement.transportartifact.nonviolentt.. 1.0000 1.0000 1.0000 1\nmovement.transportartifact.prevententry 1.0000 1.0000 1.0000 3\nmovement.transportartifact.preventexit 1.0000 1.0000 1.0000 5\nmovement.transportartifact.receiveimport 1.0000 1.0000 1.0000 1\nmovement.transportartifact.sendsupplye.. 1.0000 0.8000 0.8889 5\nmovement.transportartifact.smuggleextr.. 1.0000 1.0000 1.0000 3\nmovement.transportperson.dispersesepar.. 1.0000 1.0000 1.0000 3\nmovement.transportperson.evacuationres.. 0.8889 0.8889 0.8889 9\nmovement.transportperson.grantentryasy.. 1.0000 1.0000 1.0000 4\nmovement.transportperson.n/a 1.0000 0.8889 0.9412 9\nmovement.transportperson.prevententry 1.0000 1.0000 1.0000 5\nmovement.transportperson.preventexit 1.0000 1.0000 1.0000 9\nmovement.transportperson.selfmotion 0.8750 0.8750 0.8750 8\nmovement.transportperson.smuggleextract 1.0000 1.0000 1.0000 2\npersonnel.elect.n/a 1.0000 1.0000 1.0000 3\npersonnel.elect.winelection 1.0000 1.0000 1.0000 2\npersonnel.endposition.firinglayoff 0.9167 0.9167 0.9167 12\npersonnel.endposition.n/a 1.0000 1.0000 1.0000 8\npersonnel.endposition.quitretire 1.0000 1.0000 1.0000 3\npersonnel.startposition.hiring 1.0000 1.0000 1.0000 10\npersonnel.startposition.n/a 1.0000 1.0000 1.0000 4\ntransaction.transaction.embargosanction 1.0000 1.0000 1.0000 16\ntransaction.transaction.giftgrantprovi.. 0.7143 0.8333 0.7692 6\ntransaction.transaction.n/a 1.0000 1.0000 1.0000 4\ntransaction.transaction.transfercontrol 1.0000 0.8571 0.9231 7\ntransaction.transfermoney.borrowlend 1.0000 1.0000 1.0000 4\ntransaction.transfermoney.embargosanct.. 1.0000 1.0000 1.0000 9\ntransaction.transfermoney.giftgrantpro.. 0.8889 1.0000 0.9412 8\ntransaction.transfermoney.n/a 0.8125 0.7647 0.7879 17\ntransaction.transfermoney.payforservice 0.7857 0.8462 0.8148 13\ntransaction.transfermoney.purchase 0.7500 0.8571 0.8000 14\ntransaction.transferownership.borrowlend 1.0000 1.0000 1.0000 8\ntransaction.transferownership.embargos.. 0.9333 1.0000 0.9655 14\ntransaction.transferownership.giftgran.. 0.8750 1.0000 0.9333 7\ntransaction.transferownership.n/a 1.0000 1.0000 1.0000 14\ntransaction.transferownership.purchase 0.8667 1.0000 0.9286 13\n----------------------------------------------------------------------------------\nmicro avg 0.9084 0.9297 0.9189 896\nmacro avg 0.9264 0.9413 0.9325 896", "eval_event_trigger_relaxed_micro_precision": 0.9182115594329335, "eval_event_trigger_relaxed_micro_recall": 0.9397321428571429, "eval_event_trigger_relaxed_micro_f1": 0.9288472145615003, "eval_event_trigger_relaxed_macro_precision": 0.9427806202434177, "eval_event_trigger_relaxed_macro_recall": 0.9583086548031777, "eval_event_trigger_relaxed_macro_f1": 0.9491889499558065, "eval_event_trigger_relaxed_support": 896, "eval_event_trigger_relaxed_classification_report": "label precision recall f1 support\n----------------------------------------------------------------------------------\nartifactexistence.damagedestroy.damage 1.0000 1.0000 1.0000 7\nartifactexistence.damagedestroy.destroy 0.8462 0.8462 0.8462 13\nartifactexistence.damagedestroy.n/a 1.0000 1.0000 1.0000 8\nconflict.attack.airstrikemissilestrike 1.0000 1.0000 1.0000 4\nconflict.attack.biologicalchemicalpois.. 1.0000 1.0000 1.0000 3\nconflict.attack.bombing 0.6667 0.5714 0.6154 7\nconflict.attack.firearmattack 0.5000 0.5000 0.5000 2\nconflict.attack.invade 1.0000 1.0000 1.0000 1\nconflict.attack.n/a 0.7895 0.8571 0.8219 35\nconflict.attack.selfdirectedbattle 0.8537 0.8537 0.8537 41\nconflict.attack.setfire 1.0000 1.0000 1.0000 1\nconflict.attack.stabbing 1.0000 1.0000 1.0000 1\nconflict.attack.stealrobhijack 1.0000 1.0000 1.0000 5\nconflict.demonstrate.marchprotestpolit.. 1.0000 1.0000 1.0000 2\nconflict.yield.n/a 0.7778 1.0000 0.8750 7\nconflict.yield.retreat 1.0000 1.0000 1.0000 3\nconflict.yield.surrender 1.0000 1.0000 1.0000 5\ncontact.collaborate.correspondence 1.0000 1.0000 1.0000 7\ncontact.collaborate.n/a 1.0000 1.0000 1.0000 7\ncontact.commandorder.broadcast 1.0000 1.0000 1.0000 6\ncontact.commandorder.correspondence 1.0000 1.0000 1.0000 1\ncontact.commandorder.meet 1.0000 1.0000 1.0000 3\ncontact.commandorder.n/a 1.0000 1.0000 1.0000 4\ncontact.commitmentpromiseexpressintent.. 1.0000 1.0000 1.0000 5\ncontact.commitmentpromiseexpressintent.. 1.0000 1.0000 1.0000 6\ncontact.commitmentpromiseexpressintent.. 0.8571 1.0000 0.9231 12\ncontact.commitmentpromiseexpressintent.. 1.0000 1.0000 1.0000 2\ncontact.discussion.correspondence 1.0000 1.0000 1.0000 11\ncontact.discussion.meet 0.8889 0.9412 0.9143 17\ncontact.discussion.n/a 0.8000 1.0000 0.8889 4\ncontact.funeralvigil.meet 1.0000 1.0000 1.0000 1\ncontact.funeralvigil.n/a 1.0000 1.0000 1.0000 1\ncontact.mediastatement.broadcast 1.0000 1.0000 1.0000 6\ncontact.mediastatement.n/a 1.0000 1.0000 1.0000 3\ncontact.negotiate.correspondence 1.0000 1.0000 1.0000 2\ncontact.negotiate.meet 1.0000 1.0000 1.0000 8\ncontact.negotiate.n/a 1.0000 1.0000 1.0000 1\ncontact.prevarication.broadcast 1.0000 1.0000 1.0000 8\ncontact.prevarication.correspondence 1.0000 1.0000 1.0000 9\ncontact.prevarication.meet 1.0000 1.0000 1.0000 10\ncontact.prevarication.n/a 1.0000 1.0000 1.0000 4\ncontact.publicstatementinperson.broadc.. 1.0000 1.0000 1.0000 6\ncontact.publicstatementinperson.n/a 1.0000 1.0000 1.0000 5\ncontact.requestadvise.broadcast 0.9167 0.9167 0.9167 12\ncontact.requestadvise.correspondence 1.0000 1.0000 1.0000 10\ncontact.requestadvise.meet 1.0000 1.0000 1.0000 7\ncontact.requestadvise.n/a 1.0000 1.0000 1.0000 6\ncontact.threatencoerce.broadcast 1.0000 1.0000 1.0000 4\ncontact.threatencoerce.correspondence 0.8333 1.0000 0.9091 5\ncontact.threatencoerce.meet 1.0000 1.0000 1.0000 3\ncontact.threatencoerce.n/a 1.0000 1.0000 1.0000 6\ndisaster.accidentcrash.accidentcrash 1.0000 1.0000 1.0000 3\ndisaster.fireexplosion.fireexplosion 0.7500 1.0000 0.8571 3\ngovernment.agreements.acceptagreementc.. 1.0000 1.0000 1.0000 6\ngovernment.agreements.n/a 1.0000 1.0000 1.0000 3\ngovernment.agreements.violateagreement 1.0000 1.0000 1.0000 2\ngovernment.formation.n/a 1.0000 1.0000 1.0000 1\ngovernment.formation.startgpe 1.0000 1.0000 1.0000 1\ngovernment.legislate.legislate 1.0000 1.0000 1.0000 7\ngovernment.spy.spy 0.9091 0.8333 0.8696 12\ngovernment.vote.castvote 0.7500 1.0000 0.8571 3\ngovernment.vote.n/a 0.8000 1.0000 0.8889 4\ngovernment.vote.violationspreventvote 1.0000 1.0000 1.0000 2\ninspection.sensoryobserve.inspectpeopl.. 1.0000 1.0000 1.0000 6\ninspection.sensoryobserve.monitorelect.. 1.0000 1.0000 1.0000 3\ninspection.sensoryobserve.n/a 1.0000 1.0000 1.0000 1\ninspection.sensoryobserve.physicalinve.. 0.6667 1.0000 0.8000 4\njustice.arrestjaildetain.arrestjaildet.. 0.7778 0.8750 0.8235 8\njustice.initiatejudicialprocess.charge.. 0.8333 0.8333 0.8333 6\njustice.initiatejudicialprocess.n/a 1.0000 1.0000 1.0000 4\njustice.initiatejudicialprocess.trialh.. 1.0000 1.0000 1.0000 8\njustice.investigate.investigatecrime 1.0000 1.0000 1.0000 8\njustice.investigate.n/a 1.0000 1.0000 1.0000 2\njustice.judicialconsequences.convict 1.0000 1.0000 1.0000 8\njustice.judicialconsequences.execute 1.0000 1.0000 1.0000 5\njustice.judicialconsequences.extradite 1.0000 1.0000 1.0000 2\njustice.judicialconsequences.n/a 0.8333 0.8333 0.8333 6\nlife.die.deathcausedbyviolentevents 0.9545 0.9767 0.9655 43\nlife.die.n/a 0.8571 0.9000 0.8780 20\nlife.die.nonviolentdeath 1.0000 1.0000 1.0000 10\nlife.injure.illnessdegradationhungerth.. 0.8571 0.7500 0.8000 8\nlife.injure.illnessdegradationphysical 1.0000 1.0000 1.0000 5\nlife.injure.injurycausedbyviolentevents 0.7407 0.7692 0.7547 26\nlife.injure.n/a 0.9200 0.9200 0.9200 25\nmanufacture.artifact.build 1.0000 1.0000 1.0000 3\nmanufacture.artifact.createintellectua.. 1.0000 1.0000 1.0000 1\nmanufacture.artifact.createmanufacture 1.0000 1.0000 1.0000 4\nmanufacture.artifact.n/a 1.0000 1.0000 1.0000 6\nmovement.transportartifact.bringcarryu.. 1.0000 1.0000 1.0000 3\nmovement.transportartifact.dispersesep.. 1.0000 1.0000 1.0000 1\nmovement.transportartifact.fall 0.0000 0.0000 0.0000 1\nmovement.transportartifact.grantentry 1.0000 1.0000 1.0000 2\nmovement.transportartifact.hide 1.0000 1.0000 1.0000 2\nmovement.transportartifact.n/a 0.8750 0.8750 0.8750 8\nmovement.transportartifact.nonviolentt.. 1.0000 1.0000 1.0000 1\nmovement.transportartifact.prevententry 1.0000 1.0000 1.0000 3\nmovement.transportartifact.preventexit 1.0000 1.0000 1.0000 5\nmovement.transportartifact.receiveimport 1.0000 1.0000 1.0000 1\nmovement.transportartifact.sendsupplye.. 1.0000 0.8000 0.8889 5\nmovement.transportartifact.smuggleextr.. 1.0000 1.0000 1.0000 3\nmovement.transportperson.dispersesepar.. 1.0000 1.0000 1.0000 3\nmovement.transportperson.evacuationres.. 0.8889 0.8889 0.8889 9\nmovement.transportperson.grantentryasy.. 1.0000 1.0000 1.0000 4\nmovement.transportperson.n/a 1.0000 0.8889 0.9412 9\nmovement.transportperson.prevententry 1.0000 1.0000 1.0000 5\nmovement.transportperson.preventexit 1.0000 1.0000 1.0000 9\nmovement.transportperson.selfmotion 0.8750 0.8750 0.8750 8\nmovement.transportperson.smuggleextract 1.0000 1.0000 1.0000 2\npersonnel.elect.n/a 1.0000 1.0000 1.0000 3\npersonnel.elect.winelection 1.0000 1.0000 1.0000 2\npersonnel.endposition.firinglayoff 0.9167 0.9167 0.9167 12\npersonnel.endposition.n/a 1.0000 1.0000 1.0000 8\npersonnel.endposition.quitretire 1.0000 1.0000 1.0000 3\npersonnel.startposition.hiring 1.0000 1.0000 1.0000 10\npersonnel.startposition.n/a 1.0000 1.0000 1.0000 4\ntransaction.transaction.embargosanction 1.0000 1.0000 1.0000 16\ntransaction.transaction.giftgrantprovi.. 0.7143 0.8333 0.7692 6\ntransaction.transaction.n/a 1.0000 1.0000 1.0000 4\ntransaction.transaction.transfercontrol 1.0000 0.8571 0.9231 7\ntransaction.transfermoney.borrowlend 1.0000 1.0000 1.0000 4\ntransaction.transfermoney.embargosanct.. 1.0000 1.0000 1.0000 9\ntransaction.transfermoney.giftgrantpro.. 0.8889 1.0000 0.9412 8\ntransaction.transfermoney.n/a 0.8125 0.7647 0.7879 17\ntransaction.transfermoney.payforservice 0.7857 0.8462 0.8148 13\ntransaction.transfermoney.purchase 0.7500 0.8571 0.8000 14\ntransaction.transferownership.borrowlend 1.0000 1.0000 1.0000 8\ntransaction.transferownership.embargos.. 0.9333 1.0000 0.9655 14\ntransaction.transferownership.giftgran.. 0.8750 1.0000 0.9333 7\ntransaction.transferownership.n/a 1.0000 1.0000 1.0000 14\ntransaction.transferownership.purchase 0.8667 1.0000 0.9286 13\n----------------------------------------------------------------------------------\nmicro avg 0.9182 0.9397 0.9288 896\nmacro avg 0.9428 0.9583 0.9492 896", "eval_event_argument_strict_micro_precision": 0.42221135029354206, "eval_event_argument_strict_micro_recall": 0.39550870760769935, "eval_event_argument_strict_micro_f1": 0.4084240416469475, "eval_event_argument_strict_macro_precision": 0.37128674510565446, "eval_event_argument_strict_macro_recall": 0.35766459563578196, "eval_event_argument_strict_macro_f1": 0.36174564624976624, "eval_event_argument_strict_support": 2182, "eval_event_argument_strict_classification_report": "label precision recall f1 support\n----------------------------------------------------------------------------------\nartifact 0.5417 0.5000 0.5200 104\nartifactmoney 0.0000 0.0000 0.0000 6\nattacker 0.3908 0.4250 0.4072 80\nballot 0.0000 0.0000 0.0000 1\nbeneficiary 0.2603 0.2289 0.2436 83\ncandidate 0.4286 0.3333 0.3750 9\ncommunicator 0.5603 0.5683 0.5643 139\ncrashobject 0.0000 0.0000 0.0000 2\ncrime 0.3611 0.3333 0.3467 39\ndamager 0.8333 0.7143 0.7692 7\ndamagerdestroyer 0.6667 0.7500 0.7059 8\ndeceased 1.0000 1.0000 1.0000 2\ndefendant 0.5000 0.4545 0.4762 44\ndemonstrator 0.3333 0.5000 0.4000 2\ndestination 0.3415 0.3256 0.3333 43\ndestroyer 0.3636 0.3636 0.3636 11\ndetainee 0.5000 0.5000 0.5000 8\ndriverpassenger 0.5000 0.5000 0.5000 2\nemployee 0.6471 0.6471 0.6471 34\nexecutioner 0.2000 0.3333 0.2500 3\nextraditer 0.0000 0.0000 0.0000 2\nfireexplosionobject 0.0000 0.0000 0.0000 3\nfounder 0.0000 0.0000 0.0000 2\ngiver 0.2909 0.2759 0.2832 116\ngovernmentbody 0.5714 0.5714 0.5714 7\ngpe 1.0000 1.0000 1.0000 1\ngranter 0.5000 0.5000 0.5000 4\ninjurer 0.4722 0.4146 0.4416 41\ninspectedentity 0.2500 0.1667 0.2000 6\ninspector 0.1000 0.1429 0.1176 7\ninstrument 0.4062 0.3210 0.3586 81\ninvestigator 0.4615 0.6000 0.5217 10\njailer 0.4000 0.4000 0.4000 5\njudgecourt 0.5000 0.5714 0.5333 14\nkiller 0.4545 0.3704 0.4082 27\nlaw 0.3333 0.2500 0.2857 4\nmanufacturer 0.6667 0.7273 0.6957 11\nmoney 0.2381 0.1724 0.2000 29\nmonitor 0.3333 0.3333 0.3333 3\nmonitoredentity 0.5000 0.3333 0.4000 3\nobservedentity 0.4000 0.2222 0.2857 9\norigin 0.3409 0.3333 0.3371 45\notherparticipant 0.0000 0.0000 0.0000 2\nparticipant 0.4959 0.5000 0.4979 120\npassenger 0.5484 0.5667 0.5574 30\nplace 0.4167 0.4011 0.4087 374\nplaceofemployment 0.5217 0.4444 0.4800 27\npreventer 0.3585 0.3654 0.3619 52\nprosecutor 0.2222 0.2222 0.2222 9\nrecipient 0.3886 0.3319 0.3580 226\nresult 0.0000 0.0000 0.0000 2\nretreater 0.3333 0.3333 0.3333 3\nspy 0.3636 0.3333 0.3478 12\nsurrenderer 0.2000 0.2000 0.2000 5\ntarget 0.3385 0.2933 0.3143 75\nterritoryorfacility 0.2500 0.2000 0.2222 5\ntransporter 0.4545 0.4082 0.4301 49\nvehicle 0.2500 0.1429 0.1818 7\nvictim 0.4804 0.4455 0.4623 110\nviolator 0.0000 0.0000 0.0000 2\nvoter 0.3750 0.3750 0.3750 8\nyielder 0.3750 0.4286 0.4000 7\n----------------------------------------------------------------------------------\nmicro avg 0.4222 0.3955 0.4084 2182\nmacro avg 0.3713 0.3577 0.3617 2182", "eval_event_argument_relaxed_micro_precision": 0.6766144814090019, "eval_event_argument_relaxed_micro_recall": 0.6338221814848762, "eval_event_argument_relaxed_micro_f1": 0.6545196403218173, "eval_event_argument_relaxed_macro_precision": 0.6505999033981296, "eval_event_argument_relaxed_macro_recall": 0.608648668039347, "eval_event_argument_relaxed_macro_f1": 0.6215382581275563, "eval_event_argument_relaxed_support": 2182, "eval_event_argument_relaxed_classification_report": "label precision recall f1 support\n----------------------------------------------------------------------------------\nartifact 0.8646 0.7981 0.8300 104\nartifactmoney 0.0000 0.0000 0.0000 6\nattacker 0.6667 0.7250 0.6946 80\nballot 1.0000 1.0000 1.0000 1\nbeneficiary 0.4932 0.4337 0.4615 83\ncandidate 0.8571 0.6667 0.7500 9\ncommunicator 0.7447 0.7554 0.7500 139\ncrashobject 0.5000 0.5000 0.5000 2\ncrime 0.6944 0.6410 0.6667 39\ndamager 0.8333 0.7143 0.7692 7\ndamagerdestroyer 0.8889 1.0000 0.9412 8\ndeceased 1.0000 1.0000 1.0000 2\ndefendant 0.7500 0.6818 0.7143 44\ndemonstrator 0.6667 1.0000 0.8000 2\ndestination 0.6341 0.6047 0.6190 43\ndestroyer 1.0000 1.0000 1.0000 11\ndetainee 0.6250 0.6250 0.6250 8\ndriverpassenger 0.5000 0.5000 0.5000 2\nemployee 0.7353 0.7353 0.7353 34\nexecutioner 0.4000 0.6667 0.5000 3\nextraditer 1.0000 0.5000 0.6667 2\nfireexplosionobject 0.0000 0.0000 0.0000 3\nfounder 0.5000 0.5000 0.5000 2\ngiver 0.5182 0.4914 0.5044 116\ngovernmentbody 0.5714 0.5714 0.5714 7\ngpe 1.0000 1.0000 1.0000 1\ngranter 0.5000 0.5000 0.5000 4\ninjurer 0.7222 0.6341 0.6753 41\ninspectedentity 0.5000 0.3333 0.4000 6\ninspector 0.5000 0.7143 0.5882 7\ninstrument 0.7188 0.5679 0.6345 81\ninvestigator 0.6154 0.8000 0.6957 10\njailer 0.6000 0.6000 0.6000 5\njudgecourt 0.6250 0.7143 0.6667 14\nkiller 0.7273 0.5926 0.6531 27\nlaw 1.0000 0.7500 0.8571 4\nmanufacturer 0.8333 0.9091 0.8696 11\nmoney 0.6667 0.4828 0.5600 29\nmonitor 0.6667 0.6667 0.6667 3\nmonitoredentity 1.0000 0.6667 0.8000 3\nobservedentity 0.8000 0.4444 0.5714 9\norigin 0.6818 0.6667 0.6742 45\notherparticipant 0.0000 0.0000 0.0000 2\nparticipant 0.6694 0.6750 0.6722 120\npassenger 0.6452 0.6667 0.6557 30\nplace 0.6722 0.6471 0.6594 374\nplaceofemployment 0.6522 0.5556 0.6000 27\npreventer 0.7358 0.7500 0.7429 52\nprosecutor 0.5556 0.5556 0.5556 9\nrecipient 0.6891 0.5885 0.6348 226\nresult 1.0000 0.5000 0.6667 2\nretreater 0.6667 0.6667 0.6667 3\nspy 0.5455 0.5000 0.5217 12\nsurrenderer 0.4000 0.4000 0.4000 5\ntarget 0.5846 0.5067 0.5429 75\nterritoryorfacility 0.5000 0.4000 0.4444 5\ntransporter 0.7045 0.6327 0.6667 49\nvehicle 0.5000 0.2857 0.3636 7\nvictim 0.7157 0.6636 0.6887 110\nviolator 0.0000 0.0000 0.0000 2\nvoter 0.8750 0.8750 0.8750 8\nyielder 0.6250 0.7143 0.6667 7\n----------------------------------------------------------------------------------\nmicro avg 0.6766 0.6338 0.6545 2182\nmacro avg 0.6506 0.6086 0.6215 2182", "eval_event_strict_micro_precision": 0.6710013003901171, "eval_event_strict_micro_recall": 0.6492199295420231, "eval_event_strict_micro_f1": 0.6599309374600333, "eval_event_strict_macro_precision": 0.8492330165061098, "eval_event_strict_macro_recall": 0.8494524329856733, "eval_event_strict_macro_f1": 0.8481841771852491, "eval_event_strict_support": 3974, "eval_event_strict_classification_report": "label precision recall f1 support\n----------------------------------------------------------------------------------\narg:artifact 0.5417 0.5000 0.5200 104\narg:artifactmoney 0.0000 0.0000 0.0000 6\narg:attacker 0.3908 0.4250 0.4072 80\narg:ballot 0.0000 0.0000 0.0000 1\narg:beneficiary 0.2603 0.2289 0.2436 83\narg:candidate 0.4286 0.3333 0.3750 9\narg:communicator 0.5603 0.5683 0.5643 139\narg:crashobject 0.0000 0.0000 0.0000 2\narg:crime 0.3611 0.3333 0.3467 39\narg:damager 0.8333 0.7143 0.7692 7\narg:damagerdestroyer 0.6667 0.7500 0.7059 8\narg:deceased 1.0000 1.0000 1.0000 2\narg:defendant 0.5000 0.4545 0.4762 44\narg:demonstrator 0.3333 0.5000 0.4000 2\narg:destination 0.3415 0.3256 0.3333 43\narg:destroyer 0.3636 0.3636 0.3636 11\narg:detainee 0.5000 0.5000 0.5000 8\narg:driverpassenger 0.5000 0.5000 0.5000 2\narg:employee 0.6471 0.6471 0.6471 34\narg:executioner 0.2000 0.3333 0.2500 3\narg:extraditer 0.0000 0.0000 0.0000 2\narg:fireexplosionobject 0.0000 0.0000 0.0000 3\narg:founder 0.0000 0.0000 0.0000 2\narg:giver 0.2909 0.2759 0.2832 116\narg:governmentbody 0.5714 0.5714 0.5714 7\narg:gpe 1.0000 1.0000 1.0000 1\narg:granter 0.5000 0.5000 0.5000 4\narg:injurer 0.4722 0.4146 0.4416 41\narg:inspectedentity 0.2500 0.1667 0.2000 6\narg:inspector 0.1000 0.1429 0.1176 7\narg:instrument 0.4062 0.3210 0.3586 81\narg:investigator 0.4615 0.6000 0.5217 10\narg:jailer 0.4000 0.4000 0.4000 5\narg:judgecourt 0.5000 0.5714 0.5333 14\narg:killer 0.4545 0.3704 0.4082 27\narg:law 0.3333 0.2500 0.2857 4\narg:manufacturer 0.6667 0.7273 0.6957 11\narg:money 0.2381 0.1724 0.2000 29\narg:monitor 0.3333 0.3333 0.3333 3\narg:monitoredentity 0.5000 0.3333 0.4000 3\narg:observedentity 0.4000 0.2222 0.2857 9\narg:origin 0.3409 0.3333 0.3371 45\narg:otherparticipant 0.0000 0.0000 0.0000 2\narg:participant 0.4959 0.5000 0.4979 120\narg:passenger 0.5484 0.5667 0.5574 30\narg:place 0.4167 0.4011 0.4087 374\narg:placeofemployment 0.5217 0.4444 0.4800 27\narg:preventer 0.3585 0.3654 0.3619 52\narg:prosecutor 0.2222 0.2222 0.2222 9\narg:recipient 0.3886 0.3319 0.3580 226\narg:result 0.0000 0.0000 0.0000 2\narg:retreater 0.3333 0.3333 0.3333 3\narg:spy 0.3636 0.3333 0.3478 12\narg:surrenderer 0.2000 0.2000 0.2000 5\narg:target 0.3385 0.2933 0.3143 75\narg:territoryorfacility 0.2500 0.2000 0.2222 5\narg:transporter 0.4545 0.4082 0.4301 49\narg:vehicle 0.2500 0.1429 0.1818 7\narg:victim 0.4804 0.4455 0.4623 110\narg:violator 0.0000 0.0000 0.0000 2\narg:voter 0.3750 0.3750 0.3750 8\narg:yielder 0.3750 0.4286 0.4000 7\ntrigger:artifactexistence.damagedestro.. 1.0000 1.0000 1.0000 7\ntrigger:artifactexistence.damagedestro.. 0.8462 0.8462 0.8462 13\ntrigger:artifactexistence.damagedestro.. 1.0000 1.0000 1.0000 8\ntrigger:conflict.attack.airstrikemissi.. 1.0000 1.0000 1.0000 4\ntrigger:conflict.attack.biologicalchem.. 0.6667 0.6667 0.6667 3\ntrigger:conflict.attack.bombing 0.6667 0.5714 0.6154 7\ntrigger:conflict.attack.firearmattack 0.5000 0.5000 0.5000 2\ntrigger:conflict.attack.invade 1.0000 1.0000 1.0000 1\ntrigger:conflict.attack.n/a 0.7895 0.8571 0.8219 35\ntrigger:conflict.attack.selfdirectedba.. 0.8537 0.8537 0.8537 41\ntrigger:conflict.attack.setfire 1.0000 1.0000 1.0000 1\ntrigger:conflict.attack.stabbing 1.0000 1.0000 1.0000 1\ntrigger:conflict.attack.stealrobhijack 1.0000 1.0000 1.0000 5\ntrigger:conflict.demonstrate.marchprot.. 0.5000 0.5000 0.5000 2\ntrigger:conflict.yield.n/a 0.7778 1.0000 0.8750 7\ntrigger:conflict.yield.retreat 1.0000 1.0000 1.0000 3\ntrigger:conflict.yield.surrender 1.0000 1.0000 1.0000 5\ntrigger:contact.collaborate.correspond.. 1.0000 1.0000 1.0000 7\ntrigger:contact.collaborate.n/a 1.0000 1.0000 1.0000 7\ntrigger:contact.commandorder.broadcast 1.0000 1.0000 1.0000 6\ntrigger:contact.commandorder.correspon.. 1.0000 1.0000 1.0000 1\ntrigger:contact.commandorder.meet 1.0000 1.0000 1.0000 3\ntrigger:contact.commandorder.n/a 1.0000 1.0000 1.0000 4\ntrigger:contact.commitmentpromiseexpre.. 1.0000 1.0000 1.0000 5\ntrigger:contact.commitmentpromiseexpre.. 1.0000 1.0000 1.0000 6\ntrigger:contact.commitmentpromiseexpre.. 0.8571 1.0000 0.9231 12\ntrigger:contact.commitmentpromiseexpre.. 1.0000 1.0000 1.0000 2\ntrigger:contact.discussion.corresponde.. 1.0000 1.0000 1.0000 11\ntrigger:contact.discussion.meet 0.8889 0.9412 0.9143 17\ntrigger:contact.discussion.n/a 0.8000 1.0000 0.8889 4\ntrigger:contact.funeralvigil.meet 1.0000 1.0000 1.0000 1\ntrigger:contact.funeralvigil.n/a 1.0000 1.0000 1.0000 1\ntrigger:contact.mediastatement.broadcast 1.0000 1.0000 1.0000 6\ntrigger:contact.mediastatement.n/a 1.0000 1.0000 1.0000 3\ntrigger:contact.negotiate.correspondence 1.0000 1.0000 1.0000 2\ntrigger:contact.negotiate.meet 1.0000 1.0000 1.0000 8\ntrigger:contact.negotiate.n/a 1.0000 1.0000 1.0000 1\ntrigger:contact.prevarication.broadcast 1.0000 1.0000 1.0000 8\ntrigger:contact.prevarication.correspo.. 1.0000 1.0000 1.0000 9\ntrigger:contact.prevarication.meet 1.0000 1.0000 1.0000 10\ntrigger:contact.prevarication.n/a 1.0000 1.0000 1.0000 4\ntrigger:contact.publicstatementinperso.. 1.0000 1.0000 1.0000 6\ntrigger:contact.publicstatementinperso.. 1.0000 1.0000 1.0000 5\ntrigger:contact.requestadvise.broadcast 0.9167 0.9167 0.9167 12\ntrigger:contact.requestadvise.correspo.. 1.0000 1.0000 1.0000 10\ntrigger:contact.requestadvise.meet 1.0000 1.0000 1.0000 7\ntrigger:contact.requestadvise.n/a 1.0000 1.0000 1.0000 6\ntrigger:contact.threatencoerce.broadcast 1.0000 1.0000 1.0000 4\ntrigger:contact.threatencoerce.corresp.. 0.8333 1.0000 0.9091 5\ntrigger:contact.threatencoerce.meet 1.0000 1.0000 1.0000 3\ntrigger:contact.threatencoerce.n/a 1.0000 1.0000 1.0000 6\ntrigger:disaster.accidentcrash.acciden.. 1.0000 1.0000 1.0000 3\ntrigger:disaster.fireexplosion.fireexp.. 0.7500 1.0000 0.8571 3\ntrigger:government.agreements.acceptag.. 1.0000 1.0000 1.0000 6\ntrigger:government.agreements.n/a 1.0000 1.0000 1.0000 3\ntrigger:government.agreements.violatea.. 1.0000 1.0000 1.0000 2\ntrigger:government.formation.n/a 1.0000 1.0000 1.0000 1\ntrigger:government.formation.startgpe 1.0000 1.0000 1.0000 1\ntrigger:government.legislate.legislate 0.8571 0.8571 0.8571 7\ntrigger:government.spy.spy 0.9091 0.8333 0.8696 12\ntrigger:government.vote.castvote 0.5000 0.6667 0.5714 3\ntrigger:government.vote.n/a 0.8000 1.0000 0.8889 4\ntrigger:government.vote.violationsprev.. 0.5000 0.5000 0.5000 2\ntrigger:inspection.sensoryobserve.insp.. 1.0000 1.0000 1.0000 6\ntrigger:inspection.sensoryobserve.moni.. 1.0000 1.0000 1.0000 3\ntrigger:inspection.sensoryobserve.n/a 1.0000 1.0000 1.0000 1\ntrigger:inspection.sensoryobserve.phys.. 0.6667 1.0000 0.8000 4\ntrigger:justice.arrestjaildetain.arres.. 0.7778 0.8750 0.8235 8\ntrigger:justice.initiatejudicialproces.. 0.8333 0.8333 0.8333 6\ntrigger:justice.initiatejudicialproces.. 1.0000 1.0000 1.0000 4\ntrigger:justice.initiatejudicialproces.. 0.8750 0.8750 0.8750 8\ntrigger:justice.investigate.investigat.. 1.0000 1.0000 1.0000 8\ntrigger:justice.investigate.n/a 1.0000 1.0000 1.0000 2\ntrigger:justice.judicialconsequences.c.. 1.0000 1.0000 1.0000 8\ntrigger:justice.judicialconsequences.e.. 1.0000 1.0000 1.0000 5\ntrigger:justice.judicialconsequences.e.. 1.0000 1.0000 1.0000 2\ntrigger:justice.judicialconsequences.n/a 0.8333 0.8333 0.8333 6\ntrigger:life.die.deathcausedbyviolente.. 0.9545 0.9767 0.9655 43\ntrigger:life.die.n/a 0.8571 0.9000 0.8780 20\ntrigger:life.die.nonviolentdeath 1.0000 1.0000 1.0000 10\ntrigger:life.injure.illnessdegradation.. 0.8571 0.7500 0.8000 8\ntrigger:life.injure.illnessdegradation.. 0.8000 0.8000 0.8000 5\ntrigger:life.injure.injurycausedbyviol.. 0.7037 0.7308 0.7170 26\ntrigger:life.injure.n/a 0.8800 0.8800 0.8800 25\ntrigger:manufacture.artifact.build 1.0000 1.0000 1.0000 3\ntrigger:manufacture.artifact.createint.. 1.0000 1.0000 1.0000 1\ntrigger:manufacture.artifact.createman.. 1.0000 1.0000 1.0000 4\ntrigger:manufacture.artifact.n/a 1.0000 1.0000 1.0000 6\ntrigger:movement.transportartifact.bri.. 1.0000 1.0000 1.0000 3\ntrigger:movement.transportartifact.dis.. 1.0000 1.0000 1.0000 1\ntrigger:movement.transportartifact.fall 0.0000 0.0000 0.0000 1\ntrigger:movement.transportartifact.gra.. 1.0000 1.0000 1.0000 2\ntrigger:movement.transportartifact.hide 1.0000 1.0000 1.0000 2\ntrigger:movement.transportartifact.n/a 0.8750 0.8750 0.8750 8\ntrigger:movement.transportartifact.non.. 1.0000 1.0000 1.0000 1\ntrigger:movement.transportartifact.pre.. 1.0000 1.0000 1.0000 3\ntrigger:movement.transportartifact.pre.. 1.0000 1.0000 1.0000 5\ntrigger:movement.transportartifact.rec.. 1.0000 1.0000 1.0000 1\ntrigger:movement.transportartifact.sen.. 1.0000 0.8000 0.8889 5\ntrigger:movement.transportartifact.smu.. 1.0000 1.0000 1.0000 3\ntrigger:movement.transportperson.dispe.. 1.0000 1.0000 1.0000 3\ntrigger:movement.transportperson.evacu.. 0.8889 0.8889 0.8889 9\ntrigger:movement.transportperson.grant.. 1.0000 1.0000 1.0000 4\ntrigger:movement.transportperson.n/a 1.0000 0.8889 0.9412 9\ntrigger:movement.transportperson.preve.. 1.0000 1.0000 1.0000 5\ntrigger:movement.transportperson.preve.. 1.0000 1.0000 1.0000 9\ntrigger:movement.transportperson.selfm.. 0.8750 0.8750 0.8750 8\ntrigger:movement.transportperson.smugg.. 1.0000 1.0000 1.0000 2\ntrigger:personnel.elect.n/a 1.0000 1.0000 1.0000 3\ntrigger:personnel.elect.winelection 1.0000 1.0000 1.0000 2\ntrigger:personnel.endposition.firingla.. 0.9167 0.9167 0.9167 12\ntrigger:personnel.endposition.n/a 1.0000 1.0000 1.0000 8\ntrigger:personnel.endposition.quitretire 1.0000 1.0000 1.0000 3\ntrigger:personnel.startposition.hiring 1.0000 1.0000 1.0000 10\ntrigger:personnel.startposition.n/a 1.0000 1.0000 1.0000 4\ntrigger:transaction.transaction.embarg.. 1.0000 1.0000 1.0000 16\ntrigger:transaction.transaction.giftgr.. 0.7143 0.8333 0.7692 6\ntrigger:transaction.transaction.n/a 1.0000 1.0000 1.0000 4\ntrigger:transaction.transaction.transf.. 1.0000 0.8571 0.9231 7\ntrigger:transaction.transfermoney.borr.. 1.0000 1.0000 1.0000 4\ntrigger:transaction.transfermoney.emba.. 1.0000 1.0000 1.0000 9\ntrigger:transaction.transfermoney.gift.. 0.8889 1.0000 0.9412 8\ntrigger:transaction.transfermoney.n/a 0.8125 0.7647 0.7879 17\ntrigger:transaction.transfermoney.payf.. 0.7857 0.8462 0.8148 13\ntrigger:transaction.transfermoney.purc.. 0.7500 0.8571 0.8000 14\ntrigger:transaction.transferownership... 1.0000 1.0000 1.0000 8\ntrigger:transaction.transferownership... 0.9333 1.0000 0.9655 14\ntrigger:transaction.transferownership... 0.8750 1.0000 0.9333 7\ntrigger:transaction.transferownership... 1.0000 1.0000 1.0000 14\ntrigger:transaction.transferownership... 0.8667 1.0000 0.9286 13\ntype:artifactexistence.damagedestroy.d.. 1.0000 1.0000 1.0000 7\ntype:artifactexistence.damagedestroy.d.. 1.0000 1.0000 1.0000 13\ntype:artifactexistence.damagedestroy.n/a 1.0000 1.0000 1.0000 8\ntype:conflict.attack.airstrikemissiles.. 1.0000 1.0000 1.0000 4\ntype:conflict.attack.biologicalchemica.. 1.0000 1.0000 1.0000 3\ntype:conflict.attack.bombing 1.0000 0.8571 0.9231 7\ntype:conflict.attack.firearmattack 1.0000 1.0000 1.0000 2\ntype:conflict.attack.invade 1.0000 1.0000 1.0000 1\ntype:conflict.attack.n/a 1.0000 0.9714 0.9855 35\ntype:conflict.attack.selfdirectedbattle 1.0000 0.9756 0.9877 41\ntype:conflict.attack.setfire 1.0000 1.0000 1.0000 1\ntype:conflict.attack.stabbing 1.0000 1.0000 1.0000 1\ntype:conflict.attack.stealrobhijack 1.0000 1.0000 1.0000 5\ntype:conflict.demonstrate.marchprotest.. 1.0000 1.0000 1.0000 2\ntype:conflict.yield.n/a 1.0000 1.0000 1.0000 7\ntype:conflict.yield.retreat 1.0000 1.0000 1.0000 3\ntype:conflict.yield.surrender 1.0000 1.0000 1.0000 5\ntype:contact.collaborate.correspondence 1.0000 1.0000 1.0000 7\ntype:contact.collaborate.n/a 1.0000 1.0000 1.0000 7\ntype:contact.commandorder.broadcast 1.0000 1.0000 1.0000 6\ntype:contact.commandorder.correspondence 1.0000 1.0000 1.0000 1\ntype:contact.commandorder.meet 1.0000 1.0000 1.0000 3\ntype:contact.commandorder.n/a 1.0000 1.0000 1.0000 4\ntype:contact.commitmentpromiseexpressi.. 1.0000 1.0000 1.0000 5\ntype:contact.commitmentpromiseexpressi.. 1.0000 1.0000 1.0000 6\ntype:contact.commitmentpromiseexpressi.. 1.0000 1.0000 1.0000 12\ntype:contact.commitmentpromiseexpressi.. 1.0000 1.0000 1.0000 2\ntype:contact.discussion.correspondence 1.0000 1.0000 1.0000 11\ntype:contact.discussion.meet 1.0000 1.0000 1.0000 17\ntype:contact.discussion.n/a 1.0000 1.0000 1.0000 4\ntype:contact.funeralvigil.meet 1.0000 1.0000 1.0000 1\ntype:contact.funeralvigil.n/a 1.0000 1.0000 1.0000 1\ntype:contact.mediastatement.broadcast 1.0000 1.0000 1.0000 6\ntype:contact.mediastatement.n/a 1.0000 1.0000 1.0000 3\ntype:contact.negotiate.correspondence 1.0000 1.0000 1.0000 2\ntype:contact.negotiate.meet 1.0000 1.0000 1.0000 8\ntype:contact.negotiate.n/a 1.0000 1.0000 1.0000 1\ntype:contact.prevarication.broadcast 1.0000 1.0000 1.0000 8\ntype:contact.prevarication.corresponde.. 1.0000 1.0000 1.0000 9\ntype:contact.prevarication.meet 1.0000 1.0000 1.0000 10\ntype:contact.prevarication.n/a 1.0000 1.0000 1.0000 4\ntype:contact.publicstatementinperson.b.. 1.0000 1.0000 1.0000 6\ntype:contact.publicstatementinperson.n/a 1.0000 1.0000 1.0000 5\ntype:contact.requestadvise.broadcast 1.0000 1.0000 1.0000 12\ntype:contact.requestadvise.corresponde.. 1.0000 1.0000 1.0000 10\ntype:contact.requestadvise.meet 1.0000 1.0000 1.0000 7\ntype:contact.requestadvise.n/a 1.0000 1.0000 1.0000 6\ntype:contact.threatencoerce.broadcast 1.0000 1.0000 1.0000 4\ntype:contact.threatencoerce.correspond.. 1.0000 1.0000 1.0000 5\ntype:contact.threatencoerce.meet 1.0000 1.0000 1.0000 3\ntype:contact.threatencoerce.n/a 1.0000 1.0000 1.0000 6\ntype:disaster.accidentcrash.accidentcr.. 1.0000 1.0000 1.0000 3\ntype:disaster.fireexplosion.fireexplos.. 1.0000 1.0000 1.0000 3\ntype:government.agreements.acceptagree.. 1.0000 1.0000 1.0000 6\ntype:government.agreements.n/a 1.0000 1.0000 1.0000 3\ntype:government.agreements.violateagre.. 1.0000 1.0000 1.0000 2\ntype:government.formation.n/a 1.0000 1.0000 1.0000 1\ntype:government.formation.startgpe 1.0000 1.0000 1.0000 1\ntype:government.legislate.legislate 1.0000 1.0000 1.0000 7\ntype:government.spy.spy 1.0000 0.9167 0.9565 12\ntype:government.vote.castvote 1.0000 1.0000 1.0000 3\ntype:government.vote.n/a 1.0000 1.0000 1.0000 4\ntype:government.vote.violationsprevent.. 1.0000 1.0000 1.0000 2\ntype:inspection.sensoryobserve.inspect.. 1.0000 1.0000 1.0000 6\ntype:inspection.sensoryobserve.monitor.. 1.0000 1.0000 1.0000 3\ntype:inspection.sensoryobserve.n/a 1.0000 1.0000 1.0000 1\ntype:inspection.sensoryobserve.physica.. 1.0000 1.0000 1.0000 4\ntype:justice.arrestjaildetain.arrestja.. 1.0000 1.0000 1.0000 8\ntype:justice.initiatejudicialprocess.c.. 1.0000 1.0000 1.0000 6\ntype:justice.initiatejudicialprocess.n/a 1.0000 1.0000 1.0000 4\ntype:justice.initiatejudicialprocess.t.. 1.0000 1.0000 1.0000 8\ntype:justice.investigate.investigatecr.. 1.0000 1.0000 1.0000 8\ntype:justice.investigate.n/a 1.0000 1.0000 1.0000 2\ntype:justice.judicialconsequences.conv.. 1.0000 1.0000 1.0000 8\ntype:justice.judicialconsequences.exec.. 1.0000 1.0000 1.0000 5\ntype:justice.judicialconsequences.extr.. 1.0000 1.0000 1.0000 2\ntype:justice.judicialconsequences.n/a 1.0000 1.0000 1.0000 6\ntype:life.die.deathcausedbyviolentevents 1.0000 0.9767 0.9882 43\ntype:life.die.n/a 1.0000 1.0000 1.0000 20\ntype:life.die.nonviolentdeath 1.0000 1.0000 1.0000 10\ntype:life.injure.illnessdegradationhun.. 1.0000 0.8750 0.9333 8\ntype:life.injure.illnessdegradationphy.. 1.0000 1.0000 1.0000 5\ntype:life.injure.injurycausedbyviolent.. 1.0000 0.9615 0.9804 26\ntype:life.injure.n/a 1.0000 0.9600 0.9796 25\ntype:manufacture.artifact.build 1.0000 1.0000 1.0000 3\ntype:manufacture.artifact.createintell.. 1.0000 1.0000 1.0000 1\ntype:manufacture.artifact.createmanufa.. 1.0000 1.0000 1.0000 4\ntype:manufacture.artifact.n/a 1.0000 1.0000 1.0000 6\ntype:movement.transportartifact.bringc.. 1.0000 1.0000 1.0000 3\ntype:movement.transportartifact.disper.. 1.0000 1.0000 1.0000 1\ntype:movement.transportartifact.fall 1.0000 1.0000 1.0000 1\ntype:movement.transportartifact.grante.. 1.0000 1.0000 1.0000 2\ntype:movement.transportartifact.hide 1.0000 1.0000 1.0000 2\ntype:movement.transportartifact.n/a 1.0000 1.0000 1.0000 8\ntype:movement.transportartifact.nonvio.. 1.0000 1.0000 1.0000 1\ntype:movement.transportartifact.preven.. 1.0000 1.0000 1.0000 3\ntype:movement.transportartifact.preven.. 1.0000 1.0000 1.0000 5\ntype:movement.transportartifact.receiv.. 1.0000 1.0000 1.0000 1\ntype:movement.transportartifact.sendsu.. 1.0000 0.8000 0.8889 5\ntype:movement.transportartifact.smuggl.. 1.0000 1.0000 1.0000 3\ntype:movement.transportperson.disperse.. 1.0000 1.0000 1.0000 3\ntype:movement.transportperson.evacuati.. 1.0000 1.0000 1.0000 9\ntype:movement.transportperson.grantent.. 1.0000 1.0000 1.0000 4\ntype:movement.transportperson.n/a 1.0000 0.8889 0.9412 9\ntype:movement.transportperson.prevente.. 1.0000 1.0000 1.0000 5\ntype:movement.transportperson.prevente.. 1.0000 1.0000 1.0000 9\ntype:movement.transportperson.selfmotion 1.0000 1.0000 1.0000 8\ntype:movement.transportperson.smugglee.. 1.0000 1.0000 1.0000 2\ntype:personnel.elect.n/a 1.0000 1.0000 1.0000 3\ntype:personnel.elect.winelection 1.0000 1.0000 1.0000 2\ntype:personnel.endposition.firinglayoff 1.0000 1.0000 1.0000 12\ntype:personnel.endposition.n/a 1.0000 1.0000 1.0000 8\ntype:personnel.endposition.quitretire 1.0000 1.0000 1.0000 3\ntype:personnel.startposition.hiring 1.0000 1.0000 1.0000 10\ntype:personnel.startposition.n/a 1.0000 1.0000 1.0000 4\ntype:transaction.transaction.embargosa.. 1.0000 1.0000 1.0000 16\ntype:transaction.transaction.giftgrant.. 1.0000 1.0000 1.0000 6\ntype:transaction.transaction.n/a 1.0000 1.0000 1.0000 4\ntype:transaction.transaction.transferc.. 1.0000 0.8571 0.9231 7\ntype:transaction.transfermoney.borrowl.. 1.0000 1.0000 1.0000 4\ntype:transaction.transfermoney.embargo.. 1.0000 1.0000 1.0000 9\ntype:transaction.transfermoney.giftgra.. 1.0000 1.0000 1.0000 8\ntype:transaction.transfermoney.n/a 1.0000 0.9412 0.9697 17\ntype:transaction.transfermoney.payfors.. 1.0000 1.0000 1.0000 13\ntype:transaction.transfermoney.purchase 1.0000 1.0000 1.0000 14\ntype:transaction.transferownership.bor.. 1.0000 1.0000 1.0000 8\ntype:transaction.transferownership.emb.. 1.0000 1.0000 1.0000 14\ntype:transaction.transferownership.gif.. 1.0000 1.0000 1.0000 7\ntype:transaction.transferownership.n/a 1.0000 1.0000 1.0000 14\ntype:transaction.transferownership.pur.. 1.0000 1.0000 1.0000 13\n----------------------------------------------------------------------------------\nmicro avg 0.6710 0.6492 0.6599 3974\nmacro avg 0.8492 0.8495 0.8482 3974", "eval_event_relaxed_micro_precision": 0.8085825747724318, "eval_event_relaxed_micro_recall": 0.7823351786612984, "eval_event_relaxed_micro_f1": 0.7952423583578463, "eval_event_relaxed_macro_precision": 0.9096232131749326, "eval_event_relaxed_macro_recall": 0.904651184032277, "eval_event_relaxed_macro_f1": 0.9049288434814738, "eval_event_relaxed_support": 3974, "eval_event_relaxed_classification_report": "label precision recall f1 support\n----------------------------------------------------------------------------------\narg:artifact 0.8646 0.7981 0.8300 104\narg:artifactmoney 0.0000 0.0000 0.0000 6\narg:attacker 0.6667 0.7250 0.6946 80\narg:ballot 1.0000 1.0000 1.0000 1\narg:beneficiary 0.4932 0.4337 0.4615 83\narg:candidate 0.8571 0.6667 0.7500 9\narg:communicator 0.7447 0.7554 0.7500 139\narg:crashobject 0.5000 0.5000 0.5000 2\narg:crime 0.6944 0.6410 0.6667 39\narg:damager 0.8333 0.7143 0.7692 7\narg:damagerdestroyer 0.8889 1.0000 0.9412 8\narg:deceased 1.0000 1.0000 1.0000 2\narg:defendant 0.7500 0.6818 0.7143 44\narg:demonstrator 0.6667 1.0000 0.8000 2\narg:destination 0.6341 0.6047 0.6190 43\narg:destroyer 1.0000 1.0000 1.0000 11\narg:detainee 0.6250 0.6250 0.6250 8\narg:driverpassenger 0.5000 0.5000 0.5000 2\narg:employee 0.7353 0.7353 0.7353 34\narg:executioner 0.4000 0.6667 0.5000 3\narg:extraditer 1.0000 0.5000 0.6667 2\narg:fireexplosionobject 0.0000 0.0000 0.0000 3\narg:founder 0.5000 0.5000 0.5000 2\narg:giver 0.5182 0.4914 0.5044 116\narg:governmentbody 0.5714 0.5714 0.5714 7\narg:gpe 1.0000 1.0000 1.0000 1\narg:granter 0.5000 0.5000 0.5000 4\narg:injurer 0.7222 0.6341 0.6753 41\narg:inspectedentity 0.5000 0.3333 0.4000 6\narg:inspector 0.5000 0.7143 0.5882 7\narg:instrument 0.7188 0.5679 0.6345 81\narg:investigator 0.6154 0.8000 0.6957 10\narg:jailer 0.6000 0.6000 0.6000 5\narg:judgecourt 0.6250 0.7143 0.6667 14\narg:killer 0.7273 0.5926 0.6531 27\narg:law 1.0000 0.7500 0.8571 4\narg:manufacturer 0.8333 0.9091 0.8696 11\narg:money 0.6667 0.4828 0.5600 29\narg:monitor 0.6667 0.6667 0.6667 3\narg:monitoredentity 1.0000 0.6667 0.8000 3\narg:observedentity 0.8000 0.4444 0.5714 9\narg:origin 0.6818 0.6667 0.6742 45\narg:otherparticipant 0.0000 0.0000 0.0000 2\narg:participant 0.6694 0.6750 0.6722 120\narg:passenger 0.6452 0.6667 0.6557 30\narg:place 0.6722 0.6471 0.6594 374\narg:placeofemployment 0.6522 0.5556 0.6000 27\narg:preventer 0.7358 0.7500 0.7429 52\narg:prosecutor 0.5556 0.5556 0.5556 9\narg:recipient 0.6891 0.5885 0.6348 226\narg:result 1.0000 0.5000 0.6667 2\narg:retreater 0.6667 0.6667 0.6667 3\narg:spy 0.5455 0.5000 0.5217 12\narg:surrenderer 0.4000 0.4000 0.4000 5\narg:target 0.5846 0.5067 0.5429 75\narg:territoryorfacility 0.5000 0.4000 0.4444 5\narg:transporter 0.7045 0.6327 0.6667 49\narg:vehicle 0.5000 0.2857 0.3636 7\narg:victim 0.7157 0.6636 0.6887 110\narg:violator 0.0000 0.0000 0.0000 2\narg:voter 0.8750 0.8750 0.8750 8\narg:yielder 0.6250 0.7143 0.6667 7\ntrigger:artifactexistence.damagedestro.. 1.0000 1.0000 1.0000 7\ntrigger:artifactexistence.damagedestro.. 0.8462 0.8462 0.8462 13\ntrigger:artifactexistence.damagedestro.. 1.0000 1.0000 1.0000 8\ntrigger:conflict.attack.airstrikemissi.. 1.0000 1.0000 1.0000 4\ntrigger:conflict.attack.biologicalchem.. 1.0000 1.0000 1.0000 3\ntrigger:conflict.attack.bombing 0.6667 0.5714 0.6154 7\ntrigger:conflict.attack.firearmattack 0.5000 0.5000 0.5000 2\ntrigger:conflict.attack.invade 1.0000 1.0000 1.0000 1\ntrigger:conflict.attack.n/a 0.7895 0.8571 0.8219 35\ntrigger:conflict.attack.selfdirectedba.. 0.8537 0.8537 0.8537 41\ntrigger:conflict.attack.setfire 1.0000 1.0000 1.0000 1\ntrigger:conflict.attack.stabbing 1.0000 1.0000 1.0000 1\ntrigger:conflict.attack.stealrobhijack 1.0000 1.0000 1.0000 5\ntrigger:conflict.demonstrate.marchprot.. 1.0000 1.0000 1.0000 2\ntrigger:conflict.yield.n/a 0.7778 1.0000 0.8750 7\ntrigger:conflict.yield.retreat 1.0000 1.0000 1.0000 3\ntrigger:conflict.yield.surrender 1.0000 1.0000 1.0000 5\ntrigger:contact.collaborate.correspond.. 1.0000 1.0000 1.0000 7\ntrigger:contact.collaborate.n/a 1.0000 1.0000 1.0000 7\ntrigger:contact.commandorder.broadcast 1.0000 1.0000 1.0000 6\ntrigger:contact.commandorder.correspon.. 1.0000 1.0000 1.0000 1\ntrigger:contact.commandorder.meet 1.0000 1.0000 1.0000 3\ntrigger:contact.commandorder.n/a 1.0000 1.0000 1.0000 4\ntrigger:contact.commitmentpromiseexpre.. 1.0000 1.0000 1.0000 5\ntrigger:contact.commitmentpromiseexpre.. 1.0000 1.0000 1.0000 6\ntrigger:contact.commitmentpromiseexpre.. 0.8571 1.0000 0.9231 12\ntrigger:contact.commitmentpromiseexpre.. 1.0000 1.0000 1.0000 2\ntrigger:contact.discussion.corresponde.. 1.0000 1.0000 1.0000 11\ntrigger:contact.discussion.meet 0.8889 0.9412 0.9143 17\ntrigger:contact.discussion.n/a 0.8000 1.0000 0.8889 4\ntrigger:contact.funeralvigil.meet 1.0000 1.0000 1.0000 1\ntrigger:contact.funeralvigil.n/a 1.0000 1.0000 1.0000 1\ntrigger:contact.mediastatement.broadcast 1.0000 1.0000 1.0000 6\ntrigger:contact.mediastatement.n/a 1.0000 1.0000 1.0000 3\ntrigger:contact.negotiate.correspondence 1.0000 1.0000 1.0000 2\ntrigger:contact.negotiate.meet 1.0000 1.0000 1.0000 8\ntrigger:contact.negotiate.n/a 1.0000 1.0000 1.0000 1\ntrigger:contact.prevarication.broadcast 1.0000 1.0000 1.0000 8\ntrigger:contact.prevarication.correspo.. 1.0000 1.0000 1.0000 9\ntrigger:contact.prevarication.meet 1.0000 1.0000 1.0000 10\ntrigger:contact.prevarication.n/a 1.0000 1.0000 1.0000 4\ntrigger:contact.publicstatementinperso.. 1.0000 1.0000 1.0000 6\ntrigger:contact.publicstatementinperso.. 1.0000 1.0000 1.0000 5\ntrigger:contact.requestadvise.broadcast 0.9167 0.9167 0.9167 12\ntrigger:contact.requestadvise.correspo.. 1.0000 1.0000 1.0000 10\ntrigger:contact.requestadvise.meet 1.0000 1.0000 1.0000 7\ntrigger:contact.requestadvise.n/a 1.0000 1.0000 1.0000 6\ntrigger:contact.threatencoerce.broadcast 1.0000 1.0000 1.0000 4\ntrigger:contact.threatencoerce.corresp.. 0.8333 1.0000 0.9091 5\ntrigger:contact.threatencoerce.meet 1.0000 1.0000 1.0000 3\ntrigger:contact.threatencoerce.n/a 1.0000 1.0000 1.0000 6\ntrigger:disaster.accidentcrash.acciden.. 1.0000 1.0000 1.0000 3\ntrigger:disaster.fireexplosion.fireexp.. 0.7500 1.0000 0.8571 3\ntrigger:government.agreements.acceptag.. 1.0000 1.0000 1.0000 6\ntrigger:government.agreements.n/a 1.0000 1.0000 1.0000 3\ntrigger:government.agreements.violatea.. 1.0000 1.0000 1.0000 2\ntrigger:government.formation.n/a 1.0000 1.0000 1.0000 1\ntrigger:government.formation.startgpe 1.0000 1.0000 1.0000 1\ntrigger:government.legislate.legislate 1.0000 1.0000 1.0000 7\ntrigger:government.spy.spy 0.9091 0.8333 0.8696 12\ntrigger:government.vote.castvote 0.7500 1.0000 0.8571 3\ntrigger:government.vote.n/a 0.8000 1.0000 0.8889 4\ntrigger:government.vote.violationsprev.. 1.0000 1.0000 1.0000 2\ntrigger:inspection.sensoryobserve.insp.. 1.0000 1.0000 1.0000 6\ntrigger:inspection.sensoryobserve.moni.. 1.0000 1.0000 1.0000 3\ntrigger:inspection.sensoryobserve.n/a 1.0000 1.0000 1.0000 1\ntrigger:inspection.sensoryobserve.phys.. 0.6667 1.0000 0.8000 4\ntrigger:justice.arrestjaildetain.arres.. 0.7778 0.8750 0.8235 8\ntrigger:justice.initiatejudicialproces.. 0.8333 0.8333 0.8333 6\ntrigger:justice.initiatejudicialproces.. 1.0000 1.0000 1.0000 4\ntrigger:justice.initiatejudicialproces.. 1.0000 1.0000 1.0000 8\ntrigger:justice.investigate.investigat.. 1.0000 1.0000 1.0000 8\ntrigger:justice.investigate.n/a 1.0000 1.0000 1.0000 2\ntrigger:justice.judicialconsequences.c.. 1.0000 1.0000 1.0000 8\ntrigger:justice.judicialconsequences.e.. 1.0000 1.0000 1.0000 5\ntrigger:justice.judicialconsequences.e.. 1.0000 1.0000 1.0000 2\ntrigger:justice.judicialconsequences.n/a 0.8333 0.8333 0.8333 6\ntrigger:life.die.deathcausedbyviolente.. 0.9545 0.9767 0.9655 43\ntrigger:life.die.n/a 0.8571 0.9000 0.8780 20\ntrigger:life.die.nonviolentdeath 1.0000 1.0000 1.0000 10\ntrigger:life.injure.illnessdegradation.. 0.8571 0.7500 0.8000 8\ntrigger:life.injure.illnessdegradation.. 1.0000 1.0000 1.0000 5\ntrigger:life.injure.injurycausedbyviol.. 0.7407 0.7692 0.7547 26\ntrigger:life.injure.n/a 0.9200 0.9200 0.9200 25\ntrigger:manufacture.artifact.build 1.0000 1.0000 1.0000 3\ntrigger:manufacture.artifact.createint.. 1.0000 1.0000 1.0000 1\ntrigger:manufacture.artifact.createman.. 1.0000 1.0000 1.0000 4\ntrigger:manufacture.artifact.n/a 1.0000 1.0000 1.0000 6\ntrigger:movement.transportartifact.bri.. 1.0000 1.0000 1.0000 3\ntrigger:movement.transportartifact.dis.. 1.0000 1.0000 1.0000 1\ntrigger:movement.transportartifact.fall 0.0000 0.0000 0.0000 1\ntrigger:movement.transportartifact.gra.. 1.0000 1.0000 1.0000 2\ntrigger:movement.transportartifact.hide 1.0000 1.0000 1.0000 2\ntrigger:movement.transportartifact.n/a 0.8750 0.8750 0.8750 8\ntrigger:movement.transportartifact.non.. 1.0000 1.0000 1.0000 1\ntrigger:movement.transportartifact.pre.. 1.0000 1.0000 1.0000 3\ntrigger:movement.transportartifact.pre.. 1.0000 1.0000 1.0000 5\ntrigger:movement.transportartifact.rec.. 1.0000 1.0000 1.0000 1\ntrigger:movement.transportartifact.sen.. 1.0000 0.8000 0.8889 5\ntrigger:movement.transportartifact.smu.. 1.0000 1.0000 1.0000 3\ntrigger:movement.transportperson.dispe.. 1.0000 1.0000 1.0000 3\ntrigger:movement.transportperson.evacu.. 0.8889 0.8889 0.8889 9\ntrigger:movement.transportperson.grant.. 1.0000 1.0000 1.0000 4\ntrigger:movement.transportperson.n/a 1.0000 0.8889 0.9412 9\ntrigger:movement.transportperson.preve.. 1.0000 1.0000 1.0000 5\ntrigger:movement.transportperson.preve.. 1.0000 1.0000 1.0000 9\ntrigger:movement.transportperson.selfm.. 0.8750 0.8750 0.8750 8\ntrigger:movement.transportperson.smugg.. 1.0000 1.0000 1.0000 2\ntrigger:personnel.elect.n/a 1.0000 1.0000 1.0000 3\ntrigger:personnel.elect.winelection 1.0000 1.0000 1.0000 2\ntrigger:personnel.endposition.firingla.. 0.9167 0.9167 0.9167 12\ntrigger:personnel.endposition.n/a 1.0000 1.0000 1.0000 8\ntrigger:personnel.endposition.quitretire 1.0000 1.0000 1.0000 3\ntrigger:personnel.startposition.hiring 1.0000 1.0000 1.0000 10\ntrigger:personnel.startposition.n/a 1.0000 1.0000 1.0000 4\ntrigger:transaction.transaction.embarg.. 1.0000 1.0000 1.0000 16\ntrigger:transaction.transaction.giftgr.. 0.7143 0.8333 0.7692 6\ntrigger:transaction.transaction.n/a 1.0000 1.0000 1.0000 4\ntrigger:transaction.transaction.transf.. 1.0000 0.8571 0.9231 7\ntrigger:transaction.transfermoney.borr.. 1.0000 1.0000 1.0000 4\ntrigger:transaction.transfermoney.emba.. 1.0000 1.0000 1.0000 9\ntrigger:transaction.transfermoney.gift.. 0.8889 1.0000 0.9412 8\ntrigger:transaction.transfermoney.n/a 0.8125 0.7647 0.7879 17\ntrigger:transaction.transfermoney.payf.. 0.7857 0.8462 0.8148 13\ntrigger:transaction.transfermoney.purc.. 0.7500 0.8571 0.8000 14\ntrigger:transaction.transferownership... 1.0000 1.0000 1.0000 8\ntrigger:transaction.transferownership... 0.9333 1.0000 0.9655 14\ntrigger:transaction.transferownership... 0.8750 1.0000 0.9333 7\ntrigger:transaction.transferownership... 1.0000 1.0000 1.0000 14\ntrigger:transaction.transferownership... 0.8667 1.0000 0.9286 13\ntype:artifactexistence.damagedestroy.d.. 1.0000 1.0000 1.0000 7\ntype:artifactexistence.damagedestroy.d.. 1.0000 1.0000 1.0000 13\ntype:artifactexistence.damagedestroy.n/a 1.0000 1.0000 1.0000 8\ntype:conflict.attack.airstrikemissiles.. 1.0000 1.0000 1.0000 4\ntype:conflict.attack.biologicalchemica.. 1.0000 1.0000 1.0000 3\ntype:conflict.attack.bombing 1.0000 0.8571 0.9231 7\ntype:conflict.attack.firearmattack 1.0000 1.0000 1.0000 2\ntype:conflict.attack.invade 1.0000 1.0000 1.0000 1\ntype:conflict.attack.n/a 1.0000 0.9714 0.9855 35\ntype:conflict.attack.selfdirectedbattle 1.0000 0.9756 0.9877 41\ntype:conflict.attack.setfire 1.0000 1.0000 1.0000 1\ntype:conflict.attack.stabbing 1.0000 1.0000 1.0000 1\ntype:conflict.attack.stealrobhijack 1.0000 1.0000 1.0000 5\ntype:conflict.demonstrate.marchprotest.. 1.0000 1.0000 1.0000 2\ntype:conflict.yield.n/a 1.0000 1.0000 1.0000 7\ntype:conflict.yield.retreat 1.0000 1.0000 1.0000 3\ntype:conflict.yield.surrender 1.0000 1.0000 1.0000 5\ntype:contact.collaborate.correspondence 1.0000 1.0000 1.0000 7\ntype:contact.collaborate.n/a 1.0000 1.0000 1.0000 7\ntype:contact.commandorder.broadcast 1.0000 1.0000 1.0000 6\ntype:contact.commandorder.correspondence 1.0000 1.0000 1.0000 1\ntype:contact.commandorder.meet 1.0000 1.0000 1.0000 3\ntype:contact.commandorder.n/a 1.0000 1.0000 1.0000 4\ntype:contact.commitmentpromiseexpressi.. 1.0000 1.0000 1.0000 5\ntype:contact.commitmentpromiseexpressi.. 1.0000 1.0000 1.0000 6\ntype:contact.commitmentpromiseexpressi.. 1.0000 1.0000 1.0000 12\ntype:contact.commitmentpromiseexpressi.. 1.0000 1.0000 1.0000 2\ntype:contact.discussion.correspondence 1.0000 1.0000 1.0000 11\ntype:contact.discussion.meet 1.0000 1.0000 1.0000 17\ntype:contact.discussion.n/a 1.0000 1.0000 1.0000 4\ntype:contact.funeralvigil.meet 1.0000 1.0000 1.0000 1\ntype:contact.funeralvigil.n/a 1.0000 1.0000 1.0000 1\ntype:contact.mediastatement.broadcast 1.0000 1.0000 1.0000 6\ntype:contact.mediastatement.n/a 1.0000 1.0000 1.0000 3\ntype:contact.negotiate.correspondence 1.0000 1.0000 1.0000 2\ntype:contact.negotiate.meet 1.0000 1.0000 1.0000 8\ntype:contact.negotiate.n/a 1.0000 1.0000 1.0000 1\ntype:contact.prevarication.broadcast 1.0000 1.0000 1.0000 8\ntype:contact.prevarication.corresponde.. 1.0000 1.0000 1.0000 9\ntype:contact.prevarication.meet 1.0000 1.0000 1.0000 10\ntype:contact.prevarication.n/a 1.0000 1.0000 1.0000 4\ntype:contact.publicstatementinperson.b.. 1.0000 1.0000 1.0000 6\ntype:contact.publicstatementinperson.n/a 1.0000 1.0000 1.0000 5\ntype:contact.requestadvise.broadcast 1.0000 1.0000 1.0000 12\ntype:contact.requestadvise.corresponde.. 1.0000 1.0000 1.0000 10\ntype:contact.requestadvise.meet 1.0000 1.0000 1.0000 7\ntype:contact.requestadvise.n/a 1.0000 1.0000 1.0000 6\ntype:contact.threatencoerce.broadcast 1.0000 1.0000 1.0000 4\ntype:contact.threatencoerce.correspond.. 1.0000 1.0000 1.0000 5\ntype:contact.threatencoerce.meet 1.0000 1.0000 1.0000 3\ntype:contact.threatencoerce.n/a 1.0000 1.0000 1.0000 6\ntype:disaster.accidentcrash.accidentcr.. 1.0000 1.0000 1.0000 3\ntype:disaster.fireexplosion.fireexplos.. 1.0000 1.0000 1.0000 3\ntype:government.agreements.acceptagree.. 1.0000 1.0000 1.0000 6\ntype:government.agreements.n/a 1.0000 1.0000 1.0000 3\ntype:government.agreements.violateagre.. 1.0000 1.0000 1.0000 2\ntype:government.formation.n/a 1.0000 1.0000 1.0000 1\ntype:government.formation.startgpe 1.0000 1.0000 1.0000 1\ntype:government.legislate.legislate 1.0000 1.0000 1.0000 7\ntype:government.spy.spy 1.0000 0.9167 0.9565 12\ntype:government.vote.castvote 1.0000 1.0000 1.0000 3\ntype:government.vote.n/a 1.0000 1.0000 1.0000 4\ntype:government.vote.violationsprevent.. 1.0000 1.0000 1.0000 2\ntype:inspection.sensoryobserve.inspect.. 1.0000 1.0000 1.0000 6\ntype:inspection.sensoryobserve.monitor.. 1.0000 1.0000 1.0000 3\ntype:inspection.sensoryobserve.n/a 1.0000 1.0000 1.0000 1\ntype:inspection.sensoryobserve.physica.. 1.0000 1.0000 1.0000 4\ntype:justice.arrestjaildetain.arrestja.. 1.0000 1.0000 1.0000 8\ntype:justice.initiatejudicialprocess.c.. 1.0000 1.0000 1.0000 6\ntype:justice.initiatejudicialprocess.n/a 1.0000 1.0000 1.0000 4\ntype:justice.initiatejudicialprocess.t.. 1.0000 1.0000 1.0000 8\ntype:justice.investigate.investigatecr.. 1.0000 1.0000 1.0000 8\ntype:justice.investigate.n/a 1.0000 1.0000 1.0000 2\ntype:justice.judicialconsequences.conv.. 1.0000 1.0000 1.0000 8\ntype:justice.judicialconsequences.exec.. 1.0000 1.0000 1.0000 5\ntype:justice.judicialconsequences.extr.. 1.0000 1.0000 1.0000 2\ntype:justice.judicialconsequences.n/a 1.0000 1.0000 1.0000 6\ntype:life.die.deathcausedbyviolentevents 1.0000 0.9767 0.9882 43\ntype:life.die.n/a 1.0000 1.0000 1.0000 20\ntype:life.die.nonviolentdeath 1.0000 1.0000 1.0000 10\ntype:life.injure.illnessdegradationhun.. 1.0000 0.8750 0.9333 8\ntype:life.injure.illnessdegradationphy.. 1.0000 1.0000 1.0000 5\ntype:life.injure.injurycausedbyviolent.. 1.0000 0.9615 0.9804 26\ntype:life.injure.n/a 1.0000 0.9600 0.9796 25\ntype:manufacture.artifact.build 1.0000 1.0000 1.0000 3\ntype:manufacture.artifact.createintell.. 1.0000 1.0000 1.0000 1\ntype:manufacture.artifact.createmanufa.. 1.0000 1.0000 1.0000 4\ntype:manufacture.artifact.n/a 1.0000 1.0000 1.0000 6\ntype:movement.transportartifact.bringc.. 1.0000 1.0000 1.0000 3\ntype:movement.transportartifact.disper.. 1.0000 1.0000 1.0000 1\ntype:movement.transportartifact.fall 1.0000 1.0000 1.0000 1\ntype:movement.transportartifact.grante.. 1.0000 1.0000 1.0000 2\ntype:movement.transportartifact.hide 1.0000 1.0000 1.0000 2\ntype:movement.transportartifact.n/a 1.0000 1.0000 1.0000 8\ntype:movement.transportartifact.nonvio.. 1.0000 1.0000 1.0000 1\ntype:movement.transportartifact.preven.. 1.0000 1.0000 1.0000 3\ntype:movement.transportartifact.preven.. 1.0000 1.0000 1.0000 5\ntype:movement.transportartifact.receiv.. 1.0000 1.0000 1.0000 1\ntype:movement.transportartifact.sendsu.. 1.0000 0.8000 0.8889 5\ntype:movement.transportartifact.smuggl.. 1.0000 1.0000 1.0000 3\ntype:movement.transportperson.disperse.. 1.0000 1.0000 1.0000 3\ntype:movement.transportperson.evacuati.. 1.0000 1.0000 1.0000 9\ntype:movement.transportperson.grantent.. 1.0000 1.0000 1.0000 4\ntype:movement.transportperson.n/a 1.0000 0.8889 0.9412 9\ntype:movement.transportperson.prevente.. 1.0000 1.0000 1.0000 5\ntype:movement.transportperson.prevente.. 1.0000 1.0000 1.0000 9\ntype:movement.transportperson.selfmotion 1.0000 1.0000 1.0000 8\ntype:movement.transportperson.smugglee.. 1.0000 1.0000 1.0000 2\ntype:personnel.elect.n/a 1.0000 1.0000 1.0000 3\ntype:personnel.elect.winelection 1.0000 1.0000 1.0000 2\ntype:personnel.endposition.firinglayoff 1.0000 1.0000 1.0000 12\ntype:personnel.endposition.n/a 1.0000 1.0000 1.0000 8\ntype:personnel.endposition.quitretire 1.0000 1.0000 1.0000 3\ntype:personnel.startposition.hiring 1.0000 1.0000 1.0000 10\ntype:personnel.startposition.n/a 1.0000 1.0000 1.0000 4\ntype:transaction.transaction.embargosa.. 1.0000 1.0000 1.0000 16\ntype:transaction.transaction.giftgrant.. 1.0000 1.0000 1.0000 6\ntype:transaction.transaction.n/a 1.0000 1.0000 1.0000 4\ntype:transaction.transaction.transferc.. 1.0000 0.8571 0.9231 7\ntype:transaction.transfermoney.borrowl.. 1.0000 1.0000 1.0000 4\ntype:transaction.transfermoney.embargo.. 1.0000 1.0000 1.0000 9\ntype:transaction.transfermoney.giftgra.. 1.0000 1.0000 1.0000 8\ntype:transaction.transfermoney.n/a 1.0000 0.9412 0.9697 17\ntype:transaction.transfermoney.payfors.. 1.0000 1.0000 1.0000 13\ntype:transaction.transfermoney.purchase 1.0000 1.0000 1.0000 14\ntype:transaction.transferownership.bor.. 1.0000 1.0000 1.0000 8\ntype:transaction.transferownership.emb.. 1.0000 1.0000 1.0000 14\ntype:transaction.transferownership.gif.. 1.0000 1.0000 1.0000 7\ntype:transaction.transferownership.n/a 1.0000 1.0000 1.0000 14\ntype:transaction.transferownership.pur.. 1.0000 1.0000 1.0000 13\n----------------------------------------------------------------------------------\nmicro avg 0.8086 0.7823 0.7952 3974\nmacro avg 0.9096 0.9047 0.9049 3974", "eval_event_trigger_error_COR": 833, "eval_event_trigger_error_LE": 0, "eval_event_trigger_error_BES": 3, "eval_event_trigger_error_BEL": 6, "eval_event_trigger_error_BEO": 0, "eval_event_trigger_error_LBE": 0, "eval_event_trigger_error_FP": 75, "eval_event_trigger_error_FN": 54, "eval_event_trigger_fair_micro_precision": 0.9128767123287671, "eval_event_trigger_fair_micro_recall": 0.9343802579921481, "eval_event_trigger_fair_micro_f1": 0.9235033259423503, "eval_event_trigger_fair_support": 896, "eval_event_trigger_error_report": "event_trigger error analysis (Ortmann 2022, fair evaluation)\ntype count\n-----------------\nCOR 833\nLE 0\nBES 3\nBEL 6\nBEO 0\nLBE 0\nFP 75\nFN 54\n-----------------\nfair P / R / F1: 0.9129 / 0.9344 / 0.9235", "eval_event_argument_error_COR": 1129, "eval_event_argument_error_LE": 38, "eval_event_argument_error_BES": 148, "eval_event_argument_error_BEL": 90, "eval_event_argument_error_BEO": 10, "eval_event_argument_error_LBE": 18, "eval_event_argument_error_FP": 611, "eval_event_argument_error_FN": 749, "eval_event_argument_fair_micro_precision": 0.596723044397463, "eval_event_argument_fair_micro_recall": 0.5561576354679802, "eval_event_argument_fair_micro_f1": 0.5757266700662927, "eval_event_argument_fair_support": 2182, "eval_event_argument_error_report": "event_argument error analysis (Ortmann 2022, fair evaluation)\ntype count\n-----------------\nCOR 1129\nLE 38\nBES 148\nBEL 90\nBEO 10\nLBE 18\nFP 611\nFN 749\n-----------------\nfair P / R / F1: 0.5967 / 0.5562 / 0.5757\n\nlabel confusions (gold -> pred):\n giver -> recipient: 3\n beneficiary -> giver: 2\n giver -> beneficiary: 2\n placeofemployment -> employee: 2\n recipient -> beneficiary: 2\n recipient -> giver: 2\n recipient -> money: 2\n recipient -> surrenderer: 2\n target -> attacker: 2\n transporter -> passenger: 2\n artifact -> preventer: 1\n artifact -> recipient: 1\n artifactmoney -> giver: 1\n attacker -> target: 1\n beneficiary -> place: 1\n beneficiary -> spy: 1\n communicator -> recipient: 1\n crashobject -> driverpassenger: 1\n defendant -> judgecourt: 1\n defendant -> prosecutor: 1\n destination -> origin: 1\n driverpassenger -> crashobject: 1\n fireexplosionobject -> instrument: 1\n giver -> money: 1\n giver -> place: 1\n instrument -> attacker: 1\n instrument -> fireexplosionobject: 1\n instrument -> killer: 1\n instrument -> victim: 1\n money -> recipient: 1\n observedentity -> place: 1\n origin -> destination: 1\n otherparticipant -> violator: 1\n participant -> place: 1\n place -> beneficiary: 1\n place -> injurer: 1\n place -> participant: 1\n place -> preventer: 1\n place -> target: 1\n preventer -> place: 1\n recipient -> artifactmoney: 1\n spy -> beneficiary: 1\n target -> place: 1\n territoryorfacility -> giver: 1\n transporter -> origin: 1" }