BLEU might be Guilty but References are not Innocent - https://arxiv.org/abs/2004.06063 - We show that it is possible to calculate reliable automatic scores (even with BLEU) for high quality MT output by using a novel reference generation method.
Typical references exhibit poor diversity, concentrating around translationese language. Paraphrased references cover a wider diversity of target sentences and thus do not penalize alternative but equally accurate translations.
Releasing all reference translations gives the community a chance to revisit some of their decisions and measure quality differences for modeling techniques that produce more natural or fluent output which is penalized by standard references.
BLEU might be Guilty but References are not Innocent - https://arxiv.org/abs/2004.06063 - We show that it is possible to calculate reliable automatic scores (even with BLEU) for high quality MT output by using a novel reference generation method.
Typical references exhibit poor diversity, concentrating around translationese language. Paraphrased references cover a wider diversity of target sentences and thus do not penalize alternative but equally accurate translations.
Releasing all reference translations gives the community a chance to revisit some of their decisions and measure quality differences for modeling techniques that produce more natural or fluent output which is penalized by standard references.
Traders also expressed uncertainty about the situation with China Evergrande, as the indebted property company has not provided clarification about a key interest payment.In economic news, the Commerce Department reported an unexpected increase in U.S. new home sales in August.Crude oil prices climbed Friday and front-month WTI oil futures contracts saw gains for a fifth straight week amid tighter supplies. West Texas Intermediate Crude oil futures for November rose $0.68 or 0.9 percent at 73.98 a barrel. WTI Crude futures gained 2.8 percent for the week.
The messaging service and social-media platform owes creditors roughly $700 million by the end of April, according to people briefed on the company’s plans and loan documents viewed by The Wall Street Journal. At the same time, Telegram Group Inc. must cover rising equipment and bandwidth expenses because of its rapid growth, despite going years without attempting to generate revenue.
