Comparing MT System Performance

Some MT engines are highly responsive and take feedback loops into account, others are more static. Just comparing untrained versions of MT engines and giving scores on the same content would be a biased evaluation.