# Entropy of the multinomial distribution

5 messages
Open this post in threaded view
|

## Entropy of the multinomial distribution

 It doesn't look like the entropy of the multinomial distribution is currently supported, I imagine this is a nontrivial value to calculate, are there plans to support it some time in the future? -- You received this message because you are subscribed to the Google Groups "julia-stats" group. To unsubscribe from this group and stop receiving emails from it, send an email to [hidden email]. For more options, visit https://groups.google.com/d/optout.
Open this post in threaded view
|

## Re: Entropy of the multinomial distribution

 I'm not aware of any plans for supporting this but, as usual, contributions are very welcome.On Mon, Apr 18, 2016 at 1:07 AM, Anon wrote:It doesn't look like the entropy of the multinomial distribution is currently supported, I imagine this is a nontrivial value to calculate, are there plans to support it some time in the future? -- You received this message because you are subscribed to the Google Groups "julia-stats" group. To unsubscribe from this group and stop receiving emails from it, send an email to [hidden email]. For more options, visit https://groups.google.com/d/optout. -- You received this message because you are subscribed to the Google Groups "julia-stats" group. To unsubscribe from this group and stop receiving emails from it, send an email to [hidden email]. For more options, visit https://groups.google.com/d/optout.
Open this post in threaded view
|

## Re: Entropy of the multinomial distribution

 I asked this question on stats.SE and ended up answering it myself just now, here is the link: http://stats.stackexchange.com/questions/207893/entropy-of-the-multinomial-distribution/208075#208075.The derivation is fairly straight forward and it scales linearly in both n and k, if this is acceptable then I can code it up and submit a pull request if you'd like, but it's so simple it might be easier for you to just quickly write it up since you're intimately familiar with the package while it would take me a bit of time to get up to speed on the particulars of Distributions.jl.On Monday, April 18, 2016 at 2:05:23 PM UTC-7, Andreas Noack wrote:I'm not aware of any plans for supporting this but, as usual, contributions are very welcome.On Mon, Apr 18, 2016 at 1:07 AM, Anon <esp...@...> wrote:It doesn't look like the entropy of the multinomial distribution is currently supported, I imagine this is a nontrivial value to calculate, are there plans to support it some time in the future? -- You received this message because you are subscribed to the Google Groups "julia-stats" group. To unsubscribe from this group and stop receiving emails from it, send an email to julia-stats...@googlegroups.com. For more options, visit https://groups.google.com/d/optout. -- You received this message because you are subscribed to the Google Groups "julia-stats" group. To unsubscribe from this group and stop receiving emails from it, send an email to [hidden email]. For more options, visit https://groups.google.com/d/optout.