Instanciated a mean and a variance for each component, and the categorical prior as a Dense layer with a softmax activation