Given the test example x = 5, please answer the following questions: a) Assume that the likelihood function of each category has certain parametric form. Specifically, we have p(x|w₁₂)~ N(μ₁,07) p(x₂)~ N(₂, 2). Which category should we decide on maximum-likelihood estimation is employed to make the prediction? and when

Given the test example x = 5, please answer the following questions: a) Assume that the likelihood function of each category has certain parametric form. Specifically, we have p(x|w₁₂)~ N(μ₁,07) p(x₂)~ N(₂, 2). Which category should we decide on maximum-likelihood estimation is employed to make the prediction? and when

Database System Concepts

7th Edition

ISBN:9780078022159

Author:Abraham Silberschatz Professor, Henry F. Korth, S. Sudarshan

Publisher:Abraham Silberschatz Professor, Henry F. Korth, S. Sudarshan

Chapter1: Introduction

Section: Chapter Questions

Problem 1PE

See similar textbooks

Similar questions

For logistic regression, the gradient of the cost function is given by J(0) = (i) E (he (x) – y')x;). Write down mathematical expression(s) for the correct m gradient descent update for logistic regression with a learning rate of a. (In the expression, he(x^) should be replaced by the sigmoid function.)
How do I create a function in python that will calculate the negative log likelihood for a Gaussian model with respect to mean and also variance. Please use data = [10, 25, 10, 8, 8, 9, 10, 22, 12, 13, 15, 4, 8, 9] as the distribution.
The task is to implement density estimation using the K-NN method. Obtain an iidsample of N ≥ 1 points from a univariate normal (Gaussian) distribution (let us callthe random variable X) centered at 1 and with variance 2. Now, empirically obtain anestimate of the density from the sample points using the K-NN method, for any valueof K, where 1 ≤ K ≤ N. Produce one plot for each of the following cases (each plotshould show the following three items: the N data points (instances or realizations ofX) and the true and estimated densities versus x for a large number – e.g., 1000, 10000– of discrete, linearly-spaced x values): (i) K = N = 1, (ii) K = 2, N = 10, (iii) K = 10,N = 10, (iv) K = 10, N= 1000, (v) K = 100, N= 1000, (vi) K = N = 50,000. Pleaseprovide appropriate axis labels and legends. Thus there should be a total of six ﬁgures(plots),
"When conducting a binary regression with a skewed predictor, it is often easiest to assess the need for x and log(x) by including them both in the model so that their relative contributions can be assessed directly." Show that indeed the log odds are a function of x and log(x) for the gamma distribution.
In class, we have defined the hypothesis for univariate linear regression as he(x) = 00 + 0₁x and the mean-square cost function as 2 J(00,01) Σ (ho(x²) - y(i)) ² 2m i=1 We define the following terms: m `x), y= 10. ;Σy"), xy = - ² x(1) y(i) x²: (x(1)) ² m a. Show that the optimal values of the learning parameters 00 and 0₁ are given by: 00 = y-x xy−xy x²-x² 01 = ху-ху x²-x² b. What is the advantage of expressing the learning parameters in this format? =
Students graduating Atlantis University are being administered a test to check their general competence level at the end of the study program. From a random sample of 100 students, 95 passed and 5 failed. We aim to construct a 95% confidence interval for the proportion p of students at Atlantis University who have achieved a satisfactory competence level after their studies. Answer the following questions: (a) The critical z-value for this problem (the z-value to be used) is z = (give the exact value to TWO decimal places N.xx) (b)The middle of the interval is %. (ROUND to the nearest integer) (c) The error margin is % (use one decimal only and give in terms of percentages).
Consider linear regression where y is our label vector, X is our data matrix, w is our model weights and o² is a measure of variance Using the squared error cost function has a probabilistic interpretation as: O O O Maximising the probability of the model predicting the input data, assuming our input data follows a Normal distribution N(X; Xw, o²) Maximising the probability of the model predicting the input data given the weights N(X; wy, o²) Minimising the probability of the model predicting the labels, assuming our prediction errors follow a Normal distribution N(y; Xw, o²) Maximising the values of the weights to minimise the input data N (y; w, o²) Maximising the probability of the model predicting the labels, assuming our prediction errors follow a Normal distribution N(y; Xw, o²)
Linear regression aims to fit the parameters based on the training set T.x = 1, 2,...,m} so that the hypothesis function he (x) ...... + Onxn can better predict the output y of a new input vector x. Please derive the stochastic gradient descent update rule which can update repeatedly to minimize the least squares cost function J(0). D = {(x(i),y(¹)), i 00+ 01x₁ + 0₂x₂+... = =
ANY help would be greatly appreciated. From 1965 to 1974, in U.S. there were M= 17,857,857 male livebirths and F= 16,974,194 female livebirths. We model the number of male livebirth as a binomial distribution withparameterssize = M+F and prob = p. The following code computes the maximum likelihood estimator for p. male = 17857857 female = 16974194 ll <-function(p){dbinom(male, size = male+female, prob=p, log=TRUE) } ps <-seq(0.01, 0.99, by = 0.001) ll.ps <-ll(ps) plot(ps, ll.ps, type='l') phat <- ps[which.max(ll.ps)] abline(v = phat, col='blue') QUESTION: For this problem, can you give a theoretical formula for the maximum likelihood estimator,ˆp, usingMandF? (No need to compute the numerical value.)
Logistic regression aims to train the parameters from the training set D = {(x(i),y(i)), i 1,2,...,m, y ¤ {0,1}} so that the hypothesis function h(x) = g(0¹ x) 1 (here g(z) is the logistic or sigmod function g(z) can predict the probability of a 1+ e-z new instance x being labeled as 1. Please derive the following stochastic gradient ascent update rule for a logistic regression problem. 0j = 0j + a(y(¹) — hz(x)))x; ave. =
Given a two-category classification problem under the univariate case, where there are two training sets (one for each category) as follows: D₁ = (-3,-1,0,4} D₂ = {-2,1,2,3,6,8} Given the test example x = 5, please answer the following questions: have and a) Assume that the likelihood function of each category has certain paramétric form. Specifically, we p(x | w₁) N, 07) p(x₂)~ N(μ₂, 02). Which category should we decide on when maximum-likelihood estimation is employed to make the prediction?
Let X be a random variable with density function 1) ={0. k(1 -x), if 0<*<1; otherwise. f(x) Find k, together with the expectation and the variance of the random variable Y defined as Y = 3X - 1.