Post processing

Question

Post processing

Closed this issue 6 years ago · 6 comments

Can you please give me the link for post processing of the bpe files. So that i can get the BLUE score @pjwilliams . Thank you once again.

Do you mean by this : sed -r 's/(@@ )|(@@ ?$)//g'

Answer 1 · 2018-10-08T14:01:35.000Z

Yes, that sed command will merge BPE subwords. If the only preprocessing you did was to split the input text into BPE subwords, then that's all you need to do in your postprocessing step.

…

On 8 Oct 2018, at 10:54, jigyasa06 ***@***.***> wrote: Can you please give me the link for post processing of the bpe files. So that i can get the BLUE score @pjwilliams <https://github.com/pjwilliams> . Thank you once again — You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub <#87>, or mute the thread <https://github.com/notifications/unsubscribe-auth/ABDaY49EztX0rVjVBR5fsjMpjpmE-5gpks5uiyDlgaJpZM4XMmbs>.

Answer 2 · 2018-10-08T14:45:51.000Z

but how to actually use this command .. there is no such usage direction. Like how shoukd i input my candidate file into this??
@pjwilliams

Answer 3 · 2018-10-08T15:11:25.000Z

Here is a tutorial about using sed. It should tell you what you need to know: https://linuxconfig.org/learning-linux-commands-sed

…

On 8 Oct 2018, at 15:45, jigyasa06 ***@***.***> wrote: but how to actually use this command .. there is no such usage direction. Like how shoukd i input my candidate file into this?? @pjwilliams <https://github.com/pjwilliams> — You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub <#87 (comment)>, or mute the thread <https://github.com/notifications/unsubscribe-auth/ABDaY6ogZCaCtB432GpyLCUYtTxik4e1ks5ui2UhgaJpZM4XMmbs>.

Answer 4 · 2018-10-08T15:32:20.000Z

@pjwilliams thank you so much

Answer 5 · 2018-10-08T15:34:59.000Z

In the future, please use Nematus support ( https://groups.google.com/d/forum/nematus-support ) for general support requests, and reserve Github issues for reporting bugs.

Answer 6 · 2018-10-08T15:46:34.000Z

okay @rsennrich thank you for the information. I just need to confirm this. Why is it coming like this?
sed -r 's/(@@ )|(@@ ?$)//g'
sed: illegal option -- r
usage: sed script [-Ealn] [-i extension] [file ...]
sed [-Ealn] [-i extension] [-e script] ... [-f script_file] ... [file ...
@pjwilliams .
Thank you once again for your help and support