File:Binary entropy plot.svg
Summary
Description |
en:Information entropy of a en:Bernoulli trial X. If X can assume values 0 and 1, entropy of X is defined as H(X) = -Pr(X=0) log2 Pr(X=0) - Pr(X=1) log2 Pr(X=1). It has value if Pr(X=0)=1 or Pr(X=1)=1. The entropy reaches maximum when Pr(X=0)=Pr(X=1)=1/2 (the value of entropy is then 1). The image was created in the following steps. First I have created a DVI version starting from a LaTeX/Pstricks source. Here is the code: %Plot of information entropy of Bernoulli variable
%
%latex binary_entropy_plot; dvips binary_entropy_plot
%open .ps file in gimp, choose strong antialias in both text and graphics,
%resulution 500, color mode, crop, scale to 45%, save as .png
\documentclass[12pt]{article}
\usepackage{pst-plot}
\begin{document}
\psset{unit=4cm}
\begin{pspicture}(0,0)(1.01,1)
\psgrid[gridlabels=0pt,gridcolor=lightgray,subgriddiv=10,subgridcolor=lightgray](0,0)(0,0)(1,1)
\newrgbcolor{myblue}{0 0 0.7}
\psaxes[arrows=->,arrowsize=2pt 4,Dx=0.5,Dy=0.5](0,0)(0,0)(1.1,1.1)
\psplot[plotstyle=curve,plotpoints=100,linewidth=1.8pt,linecolor=myblue]{0.0001}{0.9999}{-1 x x log 2 log div mul 1 x sub 1 x sub log 2 log div mul add mul}
\rput(0.5,-0.22){$\Pr(X=1)$}
\rput{90}(-0.28,0.5){$H(X)$}
\end{pspicture}
\end{document}
|
Date | |
Source | Own work based on: Binary entropy plot.png by Brona |
Author |
Vector: Category:Vectorizations Newer version by Rubber Duck |
SVG development | Category:Valid SVG created with Text Editor:DiagramsCategory:SVG simplified diagrams#%203.09 ![]() ![]() Please do not replace the simplified code of this file with a version created with Inkscape or any other vector graphics editor ![]() ![]() Category:Translation possible - SVGThis diagram uses embedded text that can be easily translated using a text editor. |
Licensing
I, the copyright holder of this work, hereby publish it under the following license:
![]() |
Permission is granted to copy, distribute and/or modify this document under the terms of the GNU Free Documentation License, Version 1.2 or any later version published by the Free Software Foundation; with no Invariant Sections, no Front-Cover Texts, and no Back-Cover Texts. A copy of the license is included in the section entitled GNU Free Documentation License. |
![]() ![]() ![]() |
This file is licensed under the Creative Commons Attribution-Share Alike 3.0 Unported license. | |
| ||
This licensing tag was added to this file as part of the GFDL licensing update. |
Category:Bernoulli trial
Category:CC-BY-SA-3.0-migrated
Category:Entropy and information
Category:GFDL
Category:Images with LaTeX source code
Category:License migration completed
Category:SVG simplification by embedding text
Category:SVG simplified diagrams
Category:Self-published work
Category:Translation possible - SVG
Category:Valid SVG created with Text Editor:Diagrams
Category:Vectorizations