MT model implemented by pytorch
python=3.10
pytorch=2.0.0
pytorch-cuda=11.7
spacy=3.3.1
torchtext=0.15.0
| Trial | Source text | Targer text | Language Pair |
|---|---|---|---|
| 1 | de_core_news_sm | en_core_web_sm | DE => EN |
| 2 | en_core_web_sm | de_core_news_sm | EN => DE |
Example 0
Source Text (Input) : `<s>` Ein Mann sitzt mit einem Bier in der Hand auf einem Stuhl und brät an einem `<unk>` etwas zu essen . `</s>`
Target Text (Ground Truth) : `<s>` A man sitting on a chair with a beer in his hands roasting something to eat on a wooden stick . `</s>`
Model Output : `<s>` A man is sitting in a chair with a beer while eating something in an Asian food market . `</s>`
Example 1
Source Text (Input) : `<s>` Ein Kassierer steht an einem Schalter . `</s>`
Target Text (Ground Truth) : `<s>` A bank `<unk>` standing at a counter . `</s>`
Model Output : `<s>` A crowded booth at a counter . `</s>`
Example 2
Source Text (Input) : `<s>` Zwei Frauen in Rot und ein Mann , der aus einer `<unk>` Toilette kommt . `</s>`
Target Text (Ground Truth) : `<s>` Two women wearing red and a man coming out of a port - a - `<unk>` . `</s>`
Model Output : `<s>` Two women in red and a man passing a `<unk>` . `</s>`
Example 3
Source Text (Input) : `<s>` Eine Frau in einem schwarzen T-Shirt scheint eine Rolltreppe `<unk>` . `</s>`
Target Text (Ground Truth) : `<s>` A woman wearing a black t - shirt appears to being going up a escalator . `</s>`
Model Output : `<s>` A woman in a black t - shirt appears to be an escalator . `</s>`
Example 4
Source Text (Input) : `<s>` Männer in blauer Spielkleidung sitzen in einem Bus . `</s>`
Target Text (Ground Truth) : `<s>` Men wearing blue uniforms sit on a bus . `</s>`
Model Output : `<s>` Men in a blue uniform sitting on a bus . `</s>`
Example 0 ========
Source Text (Input) : <s> A woman with black hair , wearing a black top and a red skirt is shaking her fist at somebody . </s>
Target Text (Ground Truth) : <s> Eine Frau mit schwarzem Haar , schwarzem Oberteil und einem roten Rock <unk> jemandem mit der Faust . </s>
Model Output : <s> Eine Frau mit schwarzen Haaren , schwarzem Oberteil und einem roten Rock schüttelt sich die Schulter eines <unk> . </s>
Example 1 ========
Source Text (Input) : <s> Two dogs run in a field looking at an unseen Frisbee . </s>
Target Text (Ground Truth) : <s> Zwei Hunde rennen über ein Feld und blicken dabei auf eine <unk> Frisbeescheibe . </s>
Model Output : <s> Zwei Hunde laufen auf einem Feld und werden eine <unk> Frisbee - Frisbee zu . </s>
Example 2 ========
Source Text (Input) : <s> A group of men , women , and children , all wearing hats , talk on the beach . </s>
Target Text (Ground Truth) : <s> Eine Gruppe von Männern , Frauen und Kindern , die alle Hüte tragen , unterhält sich am Strand . </s>
Model Output : <s> Eine Gruppe von Männern , Frauen , Kinder und Kindern , die Hüte tragen , reden am Strand . </s>
Example 3 ========
Source Text (Input) : <s> A man in an army uniform speaks into a microphone . </s>
Target Text (Ground Truth) : <s> Ein Mann in einer Armeeuniform spricht in ein Mikrofon . </s>
Model Output : <s> Ein Mann in einem <unk> spricht in ein Mikrofon . </s>
Example 4 ========
Source Text (Input) : <s> A man wearing headphones walks past a wall with red and purple graffiti . </s>
Target Text (Ground Truth) : <s> Ein Mann mit Kopfhörern geht an einer Mauer mit rotem und lilafarbenem Graffiti vorbei . </s>
Model Output : <s> Ein Mann mit Kopfhörern geht an einer Wand mit roten und lila Graffiti vorbei . </s>
use well fine-tuned model english speech to text
Load Speech Data(English) => ASR model => English text => MT model => Deutsch 2way
- English speech(for ASR model) + pre-trained MT model
- Speech dataset(for ASR model & MT model)
BLEU Score: {'bleu': 0.22427557431167885, 'precisions': [0.5515894452524414, 0.2970181208201823, 0.18001410768869033, 0.11366779831510122], 'brevity_penalty': 0.9320651213260389, 'length_ratio': 0.9342715713869747, 'translation_length': 48129, 'reference_length': 51515}