Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revision Previous revision
simultaneous_translation [2020/02/07 04:58]
jpino
simultaneous_translation [2020/02/07 05:04] (current)
jpino
Line 31: Line 31:
 quality and latency. You can refer to [[https://​github.com/​pytorch/​fairseq/​tree/​simulastsharedtask/​examples/​simultaneous_translation/​eval|this directory]] for the client/​server implementation. quality and latency. You can refer to [[https://​github.com/​pytorch/​fairseq/​tree/​simulastsharedtask/​examples/​simultaneous_translation/​eval|this directory]] for the client/​server implementation.
  
-Here, we provide an [[https://​github.com/​pytorch/​fairseq/​tree/​simulastsharedtask/​examples/​simultaneous_translation|example]] of using the evaluation script, as well as a simple baseline implemented in Fairseq. ​+Here, we provide an [[https://​github.com/​pytorch/​fairseq/​tree/​simulastsharedtask/​examples/​simultaneous_translation|example]] of using the evaluation script, as well as a simple baseline implemented in Fairseq
 + 
 +=== Evaluation === 
 + 
 +We will report BLEU, [[https://​arxiv.org/​abs/​1906.00048|AP,​ AL and DAL]] metrics. Systems will be ranked by BLEU score for various maximum latency thresholds (for example, all systems with latency less than 1 DAL will be ranked together, etc.).
  
 === Submission Guidelines === === Submission Guidelines ===