Please do question 3.   1- Compute the bigram count table, C(w2|w1) for the following: "A skunk sat on a stump. The stump thunk the skunk stunk, the skunk thunk the stump stunk." Put w1 in the left hand column, and w2 in the top row.  Include punctuation, clitics, and sentence start and end markers as individual tokens.  2- Compute the bigram probability table, P(w2|w1) for the phrase “A skunk sat on a stump.”, assuming the following overall unigram counts: C(a)=80, C(skunk)=100, C(sat)=20, C(on)=25, C(stump)=60, C(the)=90, C(thunk)=50, C(stunk)=75, C(,)=80.  Assume there are 50 sentences in the corpus, and they all end with a period. 3- Compute the probability and perplexity of the sentence in Question (1) using the bigram approximation.   Smoothing  4- Smooth the count table you calculated in Question (1) using Laplace smoothing, and recalculate the probability table as well. Assume V=30.  5-  Recalculate the probability and perplexity of the first sentence in Question (1) using the smoothed table.

Oh no! Our experts couldn't answer your question.

Don't worry! We won't leave you hanging. Plus, we're giving you back one question for the inconvenience.

Submit your question and receive a step-by-step explanation from our experts in as fast as 30 minutes.
You have no more questions left.
Message from our expert:
Our experts are unable to provide you with a solution at this time. Try rewording your question, and make sure to submit one question at a time. A question credit has been added to your account for future use.
Your Question:

Please do question 3.

 

1- Compute the bigram count table, C(w2|w1) for the following: "A skunk sat on a stump. The stump thunk the skunk stunk, the skunk thunk the stump stunk." Put w1 in the left hand column, and w2 in the top row.  Include punctuation, clitics, and sentence start and end markers as individual tokens. 

2- Compute the bigram probability table, P(w2|w1) for the phrase “A skunk sat on a stump.”, assuming the following overall unigram counts:

C(a)=80, C(skunk)=100, C(sat)=20, C(on)=25, C(stump)=60, C(the)=90, C(thunk)=50, C(stunk)=75, C(,)=80.  Assume there are 50 sentences in the corpus, and they all end with a period.

3- Compute the probability and perplexity of the sentence in Question (1) using the bigram approximation. 

 Smoothing 

4- Smooth the count table you calculated in Question (1) using Laplace smoothing, and recalculate the probability table as well. Assume V=30. 

5-  Recalculate the probability and perplexity of the first sentence in Question (1) using the smoothed table.