File:Binary entropy plot.svg

Summary

Description

en:Information entropy of a en:Bernoulli trial X. If X can assume values 0 and 1, entropy of X is defined as H(X) = -Pr(X=0) log2 Pr(X=0) - Pr(X=1) log2 Pr(X=1). It has value if Pr(X=0)=1 or Pr(X=1)=1. The entropy reaches maximum when Pr(X=0)=Pr(X=1)=1/2 (the value of entropy is then 1). The image was created in the following steps. First I have created a DVI version starting from a LaTeX/Pstricks source. Here is the code:

%Plot of information entropy of Bernoulli variable
%
%latex binary_entropy_plot; dvips binary_entropy_plot
%open .ps file in gimp, choose strong antialias in both text and graphics,
%resulution 500, color mode, crop, scale to 45%, save as .png
\documentclass[12pt]{article}
\usepackage{pst-plot}
\begin{document}
\psset{unit=4cm}        
\begin{pspicture}(0,0)(1.01,1)
\psgrid[gridlabels=0pt,gridcolor=lightgray,subgriddiv=10,subgridcolor=lightgray](0,0)(0,0)(1,1)
\newrgbcolor{myblue}{0 0 0.7}
\psaxes[arrows=->,arrowsize=2pt 4,Dx=0.5,Dy=0.5](0,0)(0,0)(1.1,1.1)
\psplot[plotstyle=curve,plotpoints=100,linewidth=1.8pt,linecolor=myblue]{0.0001}{0.9999}{-1 x x log 2 log div mul 1 x sub 1 x sub log 2 log div mul add mul}
\rput(0.5,-0.22){$\Pr(X=1)$}
\rput{90}(-0.28,0.5){$H(X)$}
\end{pspicture}
\end{document}
compile it with latex to get the DVI. Then it was converted to PS with dvips. Finally it was converted to SVG using ps2svg.sh; it needed some post-processing with Inkscape
Date
Source Own work based on: Binary entropy plot.png by Brona
Author
Vector:
Category:Vectorizations
Newer version by Rubber Duck
SVG development
InfoField
 
The SVG code is valid.
Category:Valid SVG created with Text Editor:Diagrams
 
This diagram was created with a text editor.
Category:SVG simplified diagrams#%203.09
Previous version had been created with Inkscape (40763 bytes)  d  now 3.09% of previous size
 
Please do not replace the simplified code of this file with a version created with Inkscape or any other vector graphics editor
Category:SVG simplification by embedding text
 
Category:Translation possible - SVGThis diagram uses embedded text that can be easily translated using a text editor.

Licensing

I, the copyright holder of this work, hereby publish it under the following license:
GNU head Permission is granted to copy, distribute and/or modify this document under the terms of the GNU Free Documentation License, Version 1.2 or any later version published by the Free Software Foundation; with no Invariant Sections, no Front-Cover Texts, and no Back-Cover Texts. A copy of the license is included in the section entitled GNU Free Documentation License.
w:en:Creative Commons
attribution share alike
This file is licensed under the Creative Commons Attribution-Share Alike 3.0 Unported license.
You are free:
  • to share – to copy, distribute and transmit the work
  • to remix – to adapt the work
Under the following conditions:
  • attribution – You must give appropriate credit, provide a link to the license, and indicate if changes were made. You may do so in any reasonable manner, but not in any way that suggests the licensor endorses you or your use.
  • share alike – If you remix, transform, or build upon the material, you must distribute your contributions under the same or compatible license as the original.
This licensing tag was added to this file as part of the GFDL licensing update.
Category:CC-BY-SA-3.0-migrated#Binary%20entropy%20plot.svgCategory:License migration completed#Binary%20entropy%20plot.svgCategory:GFDL#Binary%20entropy%20plot.svg
Category:Self-published work Category:Bernoulli trial Category:Entropy and information Category:Images with LaTeX source code
Category:Bernoulli trial Category:CC-BY-SA-3.0-migrated Category:Entropy and information Category:GFDL Category:Images with LaTeX source code Category:License migration completed Category:SVG simplification by embedding text Category:SVG simplified diagrams Category:Self-published work Category:Translation possible - SVG Category:Valid SVG created with Text Editor:Diagrams Category:Vectorizations