| http://dbpedia.org/ontology/abstract
|
변분 베이즈 방법은 베이즈 추론과 기계 학습에서 실제로 계산하기 힘든 적분을 근사하는데 사용되는 기술들의 집합이다. 여러 관측 변수들과 파라미터, 은닉 변수등으로 구성된 그래프 모형으로 표현될 수 있는 복잡한 통계적 모형에서 사용된다. 파라미터와 은닉 변수는 관측 변수와 대비되어 관측되지 않는 변수라고 불린다.
, Variational Bayesian methods are a family … Variational Bayesian methods are a family of techniques for approximating intractable integrals arising in Bayesian inference and machine learning. They are typically used in complex statistical models consisting of observed variables (usually termed "data") as well as unknown parameters and latent variables, with various sorts of relationships among the three types of random variables, as might be described by a graphical model. As typical in Bayesian inference, the parameters and latent variables are grouped together as "unobserved variables". Variational Bayesian methods are primarily used for two purposes: 1.
* To provide an analytical approximation to the posterior probability of the unobserved variables, in order to do statistical inference over these variables. 2.
* To derive a lower bound for the marginal likelihood (sometimes called the evidence) of the observed data (i.e. the marginal probability of the data given the model, with marginalization performed over unobserved variables). This is typically used for performing model selection, the general idea being that a higher marginal likelihood for a given model indicates a better fit of the data by that model and hence a greater probability that the model in question was the one that generated the data. (See also the Bayes factor article.) In the former purpose (that of approximating a posterior probability), variational Bayes is an alternative to Monte Carlo sampling methods—particularly, Markov chain Monte Carlo methods such as Gibbs sampling—for taking a fully Bayesian approach to statistical inference over complex distributions that are difficult to evaluate directly or sample. In particular, whereas Monte Carlo techniques provide a numerical approximation to the exact posterior using a set of samples, variational Bayes provides a locally-optimal, exact analytical solution to an approximation of the posterior. Variational Bayes can be seen as an extension of the expectation-maximization (EM) algorithm from maximum a posteriori estimation (MAP estimation) of the single most probable value of each parameter to fully Bayesian estimation which computes (an approximation to) the entire posterior distribution of the parameters and latent variables. As in EM, it finds a set of optimal parameter values, and it has the same alternating structure as does EM, based on a set of interlocked (mutually dependent) equations that cannot be solved analytically. For many applications, variational Bayes produces solutions of comparable accuracy to Gibbs sampling at greater speed. However, deriving the set of equations used to update the parameters iteratively often requires a large amount of work compared with deriving the comparable Gibbs sampling equations. This is the case even for many models that are conceptually quite simple, as is demonstrated below in the case of a basic non-hierarchical model with only two parameters and no latent variables.ly two parameters and no latent variables.
|
| http://dbpedia.org/ontology/thumbnail
|
http://commons.wikimedia.org/wiki/Special:FilePath/Bregman_divergence_Pythagorean.png?width=300 +
|
| http://dbpedia.org/ontology/wikiPageExternalLink
|
http://www.gatsby.ucl.ac.uk/vbayes/ +
, http://www.cs.jhu.edu/~jason/tutorials/variational.html +
, http://www.robots.ox.ac.uk/~sjrob/Pubs/fox_vbtut.pdf +
, http://www.inference.phy.cam.ac.uk/mackay/itila/ +
, http://www.cse.buffalo.edu/faculty/mbeal/thesis/index.html +
, https://arxiv.org/abs/1803.10998 +
|
| http://dbpedia.org/ontology/wikiPageID
|
1208480
|
| http://dbpedia.org/ontology/wikiPageLength
|
56215
|
| http://dbpedia.org/ontology/wikiPageRevisionID
|
1124670523
|
| http://dbpedia.org/ontology/wikiPageWikiLink
|
http://dbpedia.org/resource/Normal_distribution +
, http://dbpedia.org/resource/Independent_identically_distributed +
, http://dbpedia.org/resource/Integral +
, http://dbpedia.org/resource/Partition_of_a_set +
, http://dbpedia.org/resource/Entropy_%28information_theory%29 +
, http://dbpedia.org/resource/Evidence_lower_bound +
, http://dbpedia.org/resource/Dirichlet_distribution +
, http://dbpedia.org/resource/Multinomial_distribution +
, http://dbpedia.org/resource/Categorical_distribution +
, http://dbpedia.org/resource/Circular_dependency +
, http://dbpedia.org/resource/Model_evidence +
, http://dbpedia.org/resource/File:CAVI_algorithm_explain.jpg +
, http://dbpedia.org/resource/Gaussian-Wishart_distribution +
, http://dbpedia.org/resource/Gaussian-gamma_distribution +
, http://dbpedia.org/resource/Maximum_entropy_discrimination +
, http://dbpedia.org/resource/File:Bayesian-gaussian-mixture-vb.svg +
, http://dbpedia.org/resource/Sample_%28statistics%29 +
, http://dbpedia.org/resource/Hyperparameters +
, http://dbpedia.org/resource/Maximum_a_posteriori +
, http://dbpedia.org/resource/Statistical_independence +
, http://dbpedia.org/resource/Latent_variable +
, http://dbpedia.org/resource/Graphical_model +
, http://dbpedia.org/resource/Covariance_matrix +
, http://dbpedia.org/resource/Conditionally_independent +
, http://dbpedia.org/resource/Monte_Carlo_sampling +
, http://dbpedia.org/resource/Joint_probability_distribution +
, http://dbpedia.org/resource/Mode_%28statistics%29 +
, http://dbpedia.org/resource/Thermodynamic_free_energy +
, http://dbpedia.org/resource/Normal-scaled_inverse_gamma_distribution +
, http://dbpedia.org/resource/Gaussian_mixture_model +
, http://dbpedia.org/resource/Joint_probability +
, http://dbpedia.org/resource/Conditional_probability_distribution +
, http://dbpedia.org/resource/Calculus_of_variations +
, http://dbpedia.org/resource/David_J.C._MacKay +
, http://dbpedia.org/resource/Variational_message_passing +
, http://dbpedia.org/resource/File:Bregman_divergence_Pythagorean.png +
, http://dbpedia.org/resource/Probability_distribution +
, http://dbpedia.org/resource/Statistical_inference +
, http://dbpedia.org/resource/Normalization_constant +
, http://dbpedia.org/resource/Wishart_distribution +
, http://dbpedia.org/resource/Bayesian_inference +
, http://dbpedia.org/resource/Hyperparameter +
, http://dbpedia.org/resource/Parameter +
, http://dbpedia.org/resource/Bayes_factor +
, http://dbpedia.org/resource/Machine_learning +
, http://dbpedia.org/resource/Completing_the_square +
, http://dbpedia.org/resource/Probability_spaces +
, http://dbpedia.org/resource/Random_variable +
, http://dbpedia.org/resource/Model_selection +
, http://dbpedia.org/resource/Bayesian_network +
, http://dbpedia.org/resource/Marginal_probability +
, http://dbpedia.org/resource/Statistical_model +
, http://dbpedia.org/resource/Multivariate_Gaussian_distribution +
, http://dbpedia.org/resource/Iterative +
, http://dbpedia.org/resource/Normalizing_constant +
, http://dbpedia.org/resource/Prior_distribution +
, http://dbpedia.org/resource/Precision_matrix +
, http://dbpedia.org/resource/Expectation-maximization +
, http://dbpedia.org/resource/Expectation_maximization +
, http://dbpedia.org/resource/Posterior_distribution +
, http://dbpedia.org/resource/Probability_density_function +
, http://dbpedia.org/resource/Gibbs_sampling +
, http://dbpedia.org/resource/Maximum_a_posteriori_estimation +
, http://dbpedia.org/resource/Lower_bound +
, http://dbpedia.org/resource/One-to-one_correspondence +
, http://dbpedia.org/resource/Limit_of_a_sequence +
, http://dbpedia.org/resource/Moment_%28mathematics%29 +
, http://dbpedia.org/resource/Exponential_family +
, http://dbpedia.org/resource/Gamma_distribution +
, http://dbpedia.org/resource/Credible_interval +
, http://dbpedia.org/resource/Probability_measure +
, http://dbpedia.org/resource/Category:Bayesian_statistics +
, http://dbpedia.org/resource/Markov_chain_Monte_Carlo +
, http://dbpedia.org/resource/Posterior_probability +
, http://dbpedia.org/resource/Expected_value +
, http://dbpedia.org/resource/Kullback%E2%80%93Leibler_divergence +
, http://dbpedia.org/resource/Marginal_likelihood +
, http://dbpedia.org/resource/Nonlinear +
, http://dbpedia.org/resource/Gaussian_distribution +
, http://dbpedia.org/resource/Conjugate_prior +
, http://dbpedia.org/resource/Variance +
, http://dbpedia.org/resource/Maximum_likelihood +
, http://dbpedia.org/resource/Generalized_filtering +
, http://dbpedia.org/resource/Mixture_model +
, http://dbpedia.org/resource/Expectation-maximization_algorithm +
, http://dbpedia.org/resource/Mean +
, http://dbpedia.org/resource/Bregman_divergence +
, http://dbpedia.org/resource/Precision_%28statistics%29 +
, http://dbpedia.org/resource/Expectation_propagation +
|
| http://dbpedia.org/property/wikiPageUsesTemplate
|
http://dbpedia.org/resource/Template:Dispute_about +
, http://dbpedia.org/resource/Template:Reflist +
, http://dbpedia.org/resource/Template:Clear +
, http://dbpedia.org/resource/Template:For +
, http://dbpedia.org/resource/Template:Math +
, http://dbpedia.org/resource/Template:Short_description +
, http://dbpedia.org/resource/Template:EquationRef +
, http://dbpedia.org/resource/Template:Doi +
, http://dbpedia.org/resource/Template:Main +
, http://dbpedia.org/resource/Template:Bayesian_statistics +
|
| http://purl.org/dc/terms/subject
|
http://dbpedia.org/resource/Category:Bayesian_statistics +
|
| http://purl.org/linguistics/gold/hypernym
|
http://dbpedia.org/resource/Family +
|
| http://www.w3.org/ns/prov#wasDerivedFrom
|
http://en.wikipedia.org/wiki/Variational_Bayesian_methods?oldid=1124670523&ns=0 +
|
| http://xmlns.com/foaf/0.1/depiction
|
http://commons.wikimedia.org/wiki/Special:FilePath/Bregman_divergence_Pythagorean.png +
, http://commons.wikimedia.org/wiki/Special:FilePath/Bayesian-gaussian-mixture-vb.svg +
, http://commons.wikimedia.org/wiki/Special:FilePath/CAVI_algorithm_explain.jpg +
|
| http://xmlns.com/foaf/0.1/isPrimaryTopicOf
|
http://en.wikipedia.org/wiki/Variational_Bayesian_methods +
|
| owl:sameAs |
http://rdf.freebase.com/ns/m.04hcx4 +
, http://fa.dbpedia.org/resource/%D8%A7%D8%B3%D8%AA%D9%86%D8%A8%D8%A7%D8%B7_%D8%A8%DB%8C%D8%B2%DB%8C_%D8%AA%D8%BA%DB%8C%DB%8C%D8%B1%D8%A7%D8%AA%DB%8C +
, https://global.dbpedia.org/id/4xacS +
, http://ko.dbpedia.org/resource/%EB%B3%80%EB%B6%84_%EB%B2%A0%EC%9D%B4%EC%A6%88_%EB%B0%A9%EB%B2%95 +
, http://www.wikidata.org/entity/Q7915794 +
, http://dbpedia.org/resource/Variational_Bayesian_methods +
|
| rdfs:comment |
Variational Bayesian methods are a family … Variational Bayesian methods are a family of techniques for approximating intractable integrals arising in Bayesian inference and machine learning. They are typically used in complex statistical models consisting of observed variables (usually termed "data") as well as unknown parameters and latent variables, with various sorts of relationships among the three types of random variables, as might be described by a graphical model. As typical in Bayesian inference, the parameters and latent variables are grouped together as "unobserved variables". Variational Bayesian methods are primarily used for two purposes:thods are primarily used for two purposes:
, 변분 베이즈 방법은 베이즈 추론과 기계 학습에서 실제로 계산하기 힘든 적분을 근사하는데 사용되는 기술들의 집합이다. 여러 관측 변수들과 파라미터, 은닉 변수등으로 구성된 그래프 모형으로 표현될 수 있는 복잡한 통계적 모형에서 사용된다. 파라미터와 은닉 변수는 관측 변수와 대비되어 관측되지 않는 변수라고 불린다.
|
| rdfs:label |
변분 베이즈 방법
, Variational Bayesian methods
|
