aboutsummaryrefslogtreecommitdiff
path: root/public/golang-profiling-simplified.html
diff options
context:
space:
mode:
Diffstat (limited to 'public/golang-profiling-simplified.html')
-rwxr-xr-xpublic/golang-profiling-simplified.html124
1 files changed, 0 insertions, 124 deletions
diff --git a/public/golang-profiling-simplified.html b/public/golang-profiling-simplified.html
deleted file mode 100755
index f794aba..0000000
--- a/public/golang-profiling-simplified.html
+++ /dev/null
@@ -1,124 +0,0 @@
1<!doctype html><html lang=en-us><meta charset=utf-8><meta name=viewport content="width=device-width,initial-scale=1"><meta name=generator content="JBMAFP - github.com/mitjafelicijan/jbmafp"><link href="data:image/x-icon;base64,AAABAAEAEBAAAAEAIABoBAAAFgAAACgAAAAQAAAAIAAAAAEAIAAAAAAAAAQAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAL69vf8AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAv76+/8LBwQkAAAAAAAAAAAAAAAC+vb3/AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAL+9vf/Bv78JAAAAAAAAAAAAAAAAu7q6/wAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAC7ubr/vr29CAAAAAAAAAAAy8nJAZ6foP8AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAnqGj/6GipAoAAAAAHLjU/xcXHf/BwsL/I8XY/yPK3v8XGiD/IbjL/yPF2f8XGiD/Fxkf/yLF2f8gnK3/Fxog/62ztv8fwNf/FRcd/x271v8mz93/GRsi/xkXHf8p097/GiIp/xobIv8p0t3/KdPe/xocIv8fYmr/KNPe/xoZH/8aHCL/J87c/xy81/8VFxz/IsPZ/8zS0/8XGiD/Ir/R/yPH2/8XGiD/Fxkf/yPH2/8dd4T/GBog/yPJ3f8jyNr/uru9/xcUGv8cudb/EhITDKi5vRKlvMP/RUpOERwcHRAdOj4QHTk8EBwdHRAdNTgQHTo/EBwcHRAcHB0QSGduEKW4vf+koqQfHzg+EBqz0ewSFRv7EyMr/xq51vsTERb7ExUb+xq41fsau9j7ExUb+xiPp/sZudb7ExUb+xMVG/sZuNX/GKvI/BIUGfMdvdn/IrfL/xcaIP8n1eb/J9Dh/xkcIf8ZGR7/J8/f/xxCSv8ZGyH/J9Dg/ybQ4P8ZHCL/FSQs/yPK3/8UExj/GE1b/ybS5P8ZGB7/Ghwj/ynW5P8p2Ob/Ghwi/yWrtv8p1eH/Ghwi/xocIv8p1uT/J8XT/xkcIv8m1un/Hb7d/xUYH/8hzOr/HtHu/xcaIf8XGB//I8vi/xgxOv8XGSD/I8rg/yPK4P8XGiD/GUFL/yPP6f8SERj/Fhkh/x3A4f8AAAAAJ2f9/ydr//8mZPH/AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAlYu38J2v//ydo/f8AAAAAAAAAAAd8/fkFqf//Iob8sAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAMY39awWr//8FfP3/AAAAAAAAAAAFm/7/SfD//wR+/f8AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAOB/f9B7v//BaX+/wAAAAAAAAAAQ878SAyZ/v9n1v4KAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAADu9v8DDJb+/z3N/XgAAAAA3/sAAN/7AADf+wAA3/sAAAAAAAAAAAAAAAAAAN/7AAAAAAAAAAAAAAAAAAAAAAAAj/EAAI/5AACP8QAA3/sAAA==" rel=icon type=image/x-icon><title>Golang profiling simplified</title><meta name=description content="Many posts have been written regarding profiling in Golang and I haven’t foundproper tutorial regarding this."><meta name=author content="Mitja Felicijan"><link rel=alternate type=application/rss+xml title="Mitja Felicijan's posts" href=https://mitjafelicijan.com/index.xml><link rel=alternate type=application/rss+xml title="Mitja Felicijan's notes" href=https://mitjafelicijan.com/notes.xml><style>:root{--border-color:gainsboro;--border-size:2px;--link-color:blue;--bg-color:#eee}*::selection{background:var(--link-color);color:#fff}*::-moz-selection{background:var(--link-color);color:#fff}*::-webkit-selection{background:var(--link-color);color:#fff}body{padding:2.5rem;max-width:1900px;background:#fff;font-family:sans-serif;line-height:1.35rem;font-size:16px}hr{border:0;border-bottom:var(--border-size)solid var(--border-color);margin-block-start:1.5rem}a{color:var(--link-color);text-decoration:none}h1,h2,h3{line-height:initial}h1{font-size:xx-large}footer{margin-block-start:2rem}cap{text-transform:capitalize}blockquote{font-style:italic}table{max-width:100%;border:var(--border-size)solid var(--border-color);border-collapse:separate;border-spacing:0}table thead tr th{border-bottom:var(--border-size)solid var(--border-color);text-align:left}table th,table td{padding:.5em .8em}ul.list li{padding:.2em 0}ul{line-height:1.35em}pre{text-wrap:nowrap;overflow-x:auto;padding:0 1em;border:var(--border-size)solid var(--border-color)}code{padding:0 3px;font-size:14px;border:0;background:var(--bg-color)}pre code{line-height:1.3em;background:#fff}pre,code,pre *,code *{font-family:monospace}figure{margin-inline-start:0;margin-inline-end:0}figcaption{width:800px;max-width:100%;text-align:center}figcaption p{margin:.3em 0 1.5em;font-style:italic}img,video,audio{width:800px;max-width:100%;border:var(--border-size)solid var(--border-color);padding:.5em}header nav{display:flex;gap:.9rem}article iframe{margin:0!important}audio::-webkit-media-controls-enclosure{border-radius:0}@media only screen and (max-width:600px){body{padding:.5em;word-wrap:break-word}header nav{gap:.7rem}header nav .hob{display:none}a{word-wrap:break-word}img,video,audio{padding:0}}</style><header><nav class=main itemscope itemtype=http://schema.org/SiteNavigationElement role=navigation aria-label="Main navigation"><a href=/>Home</a>
2<a href=/#posts>Posts</a>
3<a href=/#notes>Notes</a>
4<a href=/#sideprojects class=hob>Side Projects</a>
5<a href=/vault.html>Vault</a>
6<a href=https://github.com/mitjafelicijan target=_blank>Code</a>
7<a href=/mitjafelicijan.pgp.pub.txt target=_blank class=hob>PGP</a>
8<a href=/curriculum-vitae.html>CV</a>
9<a href=/index.xml target=_blank class=hob>RSS</a></nav></header><main role=main><article itemtype=http://schema.org/Article><h1 itemtype=headline>Golang profiling simplified</h1><p><cap>post</cap>, Mar 7, 2017 on <a href=https://mitjafelicijan.com>Mitja Felicijan's blog</a><div><p>Many posts have been written regarding profiling in Golang and I haven’t found
10proper tutorial regarding this. Almost all of them are missing some part of
11important information and it gets pretty frustrating when you have a deadline
12and are not finding simple distilled solution.<p>Nevertheless, after searching and experimenting I have found a solution that
13works for me and probably should also for you.<h2 id=where-are-my-pprof-files>Where are my pprof files?</h2><p>By default pprof files are generated in /tmp/ folder. You can override folder
14where this files are generated programmatically in your golang code as we will
15see below in example.<h2 id=why-is-my-cpu-profile-empty>Why is my CPU profile empty?</h2><p>I have found out that sometimes CPU profile is empty because program was not
16executing long enough. Programs, that execute too quickly don’t produce pprof
17file in my cases. Well, file is generated but only contains 4KB of information.<h2 id=profiling>Profiling</h2><p>As you can see from examples we are executing dummy_benchmark functions to
18ensure some sort of execution. Memory profiling can be done without such a
19“complex” function. But CPU profiling needs it.<p>Both memory and CPU profiling examples are almost the same. Only parameters in
20main function when calling profile.Start are different. When we set
21profile.ProfilePath(“.”) we tell profiler to store pprof files in the same
22folder as our program.<h3 id=memory-profiling>Memory profiling</h3><pre tabindex=0 style=background-color:#fff><code><span style=display:flex><span><span style=color:#00f>package</span> main
23</span></span><span style=display:flex><span>
24</span></span><span style=display:flex><span><span style=color:#00f>import</span> (
25</span></span><span style=display:flex><span> <span style=color:#a31515>&#34;fmt&#34;</span>
26</span></span><span style=display:flex><span> <span style=color:#a31515>&#34;time&#34;</span>
27</span></span><span style=display:flex><span> <span style=color:#a31515>&#34;github.com/pkg/profile&#34;</span>
28</span></span><span style=display:flex><span>)
29</span></span><span style=display:flex><span>
30</span></span><span style=display:flex><span><span style=color:#00f>func</span> dummy_benchmark() {
31</span></span><span style=display:flex><span>
32</span></span><span style=display:flex><span> fmt.Println(<span style=color:#a31515>&#34;first set ...&#34;</span>)
33</span></span><span style=display:flex><span> <span style=color:#00f>for</span> i := 0; i &lt; 918231333; i++ {
34</span></span><span style=display:flex><span> i *= 2
35</span></span><span style=display:flex><span> i /= 2
36</span></span><span style=display:flex><span> }
37</span></span><span style=display:flex><span>
38</span></span><span style=display:flex><span> &lt;-time.After(time.Second*3)
39</span></span><span style=display:flex><span>
40</span></span><span style=display:flex><span> fmt.Println(<span style=color:#a31515>&#34;sencond set ...&#34;</span>)
41</span></span><span style=display:flex><span> <span style=color:#00f>for</span> i := 0; i &lt; 9182312232; i++ {
42</span></span><span style=display:flex><span> i *= 2
43</span></span><span style=display:flex><span> i /= 2
44</span></span><span style=display:flex><span> }
45</span></span><span style=display:flex><span>}
46</span></span><span style=display:flex><span>
47</span></span><span style=display:flex><span><span style=color:#00f>func</span> main() {
48</span></span><span style=display:flex><span> <span style=color:#00f>defer</span> profile.Start(profile.MemProfile, profile.ProfilePath(<span style=color:#a31515>&#34;.&#34;</span>), profile.NoShutdownHook).Stop()
49</span></span><span style=display:flex><span> dummy_benchmark()
50</span></span><span style=display:flex><span>}
51</span></span></code></pre><h3 id=cpu-profiling>CPU profiling</h3><pre tabindex=0 style=background-color:#fff><code><span style=display:flex><span><span style=color:#00f>package</span> main
52</span></span><span style=display:flex><span>
53</span></span><span style=display:flex><span><span style=color:#00f>import</span> (
54</span></span><span style=display:flex><span> <span style=color:#a31515>&#34;fmt&#34;</span>
55</span></span><span style=display:flex><span> <span style=color:#a31515>&#34;time&#34;</span>
56</span></span><span style=display:flex><span> <span style=color:#a31515>&#34;github.com/pkg/profile&#34;</span>
57</span></span><span style=display:flex><span>)
58</span></span><span style=display:flex><span>
59</span></span><span style=display:flex><span><span style=color:#00f>func</span> dummy_benchmark() {
60</span></span><span style=display:flex><span>
61</span></span><span style=display:flex><span> fmt.Println(<span style=color:#a31515>&#34;first set ...&#34;</span>)
62</span></span><span style=display:flex><span> <span style=color:#00f>for</span> i := 0; i &lt; 918231333; i++ {
63</span></span><span style=display:flex><span> i *= 2
64</span></span><span style=display:flex><span> i /= 2
65</span></span><span style=display:flex><span> }
66</span></span><span style=display:flex><span>
67</span></span><span style=display:flex><span> &lt;-time.After(time.Second*3)
68</span></span><span style=display:flex><span>
69</span></span><span style=display:flex><span> fmt.Println(<span style=color:#a31515>&#34;sencond set ...&#34;</span>)
70</span></span><span style=display:flex><span> <span style=color:#00f>for</span> i := 0; i &lt; 9182312232; i++ {
71</span></span><span style=display:flex><span> i *= 2
72</span></span><span style=display:flex><span> i /= 2
73</span></span><span style=display:flex><span> }
74</span></span><span style=display:flex><span>}
75</span></span><span style=display:flex><span>
76</span></span><span style=display:flex><span><span style=color:#00f>func</span> main() {
77</span></span><span style=display:flex><span> <span style=color:#00f>defer</span> profile.Start(profile.CPUProfile, profile.ProfilePath(<span style=color:#a31515>&#34;.&#34;</span>), profile.NoShutdownHook).Stop()
78</span></span><span style=display:flex><span> dummy_benchmark()
79</span></span><span style=display:flex><span>}
80</span></span></code></pre><h3 id=generating-profiling-reports>Generating profiling reports</h3><pre tabindex=0 style=background-color:#fff><code><span style=display:flex><span><span style=color:green># memory profiling</span>
81</span></span><span style=display:flex><span>go build mem.go
82</span></span><span style=display:flex><span>./mem
83</span></span><span style=display:flex><span>go tool pprof -pdf ./mem mem.pprof &gt; mem.pdf
84</span></span><span style=display:flex><span>
85</span></span><span style=display:flex><span><span style=color:green># cpu profiling</span>
86</span></span><span style=display:flex><span>go build cpu.go
87</span></span><span style=display:flex><span>./cpu
88</span></span><span style=display:flex><span>go tool pprof -pdf ./cpu cpu.pprof &gt; cpu.pdf
89</span></span></code></pre><p>This will generate PDF document with visualized profile.<ul><li><a href=/posts/go-profiling/golang-profiling-mem.pdf>Memory PDF profile example</a><li><a href=/posts/go-profiling/golang-profiling-cpu.pdf>CPU PDF profile example</a></ul></div></article></main><section><hr><h2>Posts from blogs I follow around the net</h2><ul><li><a href=https://utcc.utoronto.ca/~cks/space/blog/linux/NFSv4ServerLockClients target=_blank rel=noopener>Finding which NFSv4 client owns a lock on a Linux NFS(v4) server</a> — <a href=https://utcc.utoronto.ca/~cks/space/blog/>Chris's Wiki :: blog</a><div>A while back I wrote an entry about finding which NFS client owns
90a lock on a Linux NFS server, which turned
91out to be specific to NFS v3 (which I really should have seen coming,
92since it involved NLM and lockd). Finding the NFS v4 client that
93owns a lock is, depending on your perspective, either simpl…<li><a href=http://www.landley.net/notes-2023.html#28-10-2023 target=_blank rel=noopener>October 28, 2023</a> — <a href=http://www.landley.net/notes-2023.html>Rob Landley's Blog Thing for 2023</a><div>Oh good grief, two of my least favorite licensing people, Larry Rosen
94and Bradley Kuhn, are interacting on the OSI's license-discuss
95list where the're doing
96bad computer history and insisting that a guy Larry Rosen
97coincidentally interviewed for a book years ago is clearly the origin of
98somethin…<li><a href="http://offbeatpursuit.com:80/blog/?id=25" target=_blank rel=noopener>A fix by any other name</a> — <a href=http://offbeatpursuit.com:80/blog/>WLOG - blog</a><div>tags:
99i2c, plan9
100Another month, another file system.
101Well, if you can’t fix it in software, fix it in hardware (looking at
102you, bme680, we’re not
103done yet). The show must go on, as they say, and I would like my
104experiments to go on.
105So a “new” addition to the environmental sensor family connected to
106the h…<li><a href=https://mirzapandzo.com/next-image-url-parameter-is-valid-but-upstream-response-is-invalid target=_blank rel=noopener>Next/Image "url" parameter is valid but upstream response is invalid</a> — <a href=https://mirzapandzo.com/>Mirza Pandzo's Blog</a><div>Getting "url" parameter is valid but upstream response is invalid error with Next/Image on WSL2<li><a href=https://drewdevault.com/2023/10/13/Going-off-script.html target=_blank rel=noopener>Going off-script</a> — <a href=https://drewdevault.com>Drew DeVault's blog</a><div>There is a phenomenon in society which I find quite bizarre. Upon our entry to
107this mortal coil, we are endowed with self-awareness, agency, and free will.
108Each of the 8 billion members of this human race represents a unique person, a
109unique worldview, and a unique agency. Yet, many of us have the sam…<li><a href=https://szymonkaliski.com/writing/2023-10-02-building-a-diy-pen-plotter/ target=_blank rel=noopener>Building a DIY Pen Plotter</a> — <a href=http://github.com/dylang/node-rss>Szymon Kaliski</a><div>This article documents my learnings from designing and building a DIY Pen Plotter during the summer of 2023.
110My ultimate goal is to build my…<li><a href=https://neil.computer/notes/chart-of-accounts-for-startups-and-saas-companies/ target=_blank rel=noopener>Chart of Accounts for Startups and SaaS Companies</a> — <a href=https://neil.computer/>Neil Panchal</a><div>Accounting is fundamental to starting a business. You need to have a basic understanding of accounting principles and essential bookkeeping. I had to learn it. There was no choice. For filing taxes, your CPA is going to ask you for an Income Statement (also known as P/L statement). If<li><a href=https://journal.valeriansaliou.name/deploy-a-nomad-cluster-on-alpine-linux-with-vultr/ target=_blank rel=noopener>Deploy a Nomad Cluster on Alpine Linux with Vultr</a> — <a href=https://journal.valeriansaliou.name/>Valerian Saliou</a><div>After spending countless hours trying to understand how to deploy my apps on Kubernetes for the first time to host Mirage, an AI API service that I run, I ended up making myself a promise that the next app I work on would be using a more productive & simpler<li><a href=https://jcs.org/2023/10/25/wifi_da target=_blank rel=noopener>BlueSCSI Wi-Fi Desk Accessory 1.0 Released</a> — <a href=https://jcs.org/>joshua stein</a><div>BlueSCSI Wi-Fi Desk Accessory
1111.0 has been released:
112wifi_da-1.0.sit
113(StuffIt 3 archive)
114SHA256: ccfc9d27dd5da7412d10cef73b81119a1fec3848e4d1d88ff652a07ffdc6a69aSHA1: ff124972f202ceda6d7fa4788110a67ccda6a13a
115This is the initial public release of my BlueSCSI Wi-Fi Desk Accessory for
116classic MacOS.<li><a href=https://michael.stapelberg.ch/posts/2023-10-25-my-all-flash-zfs-network-storage-build/ target=_blank rel=noopener>My 2023 all-flash ZFS NAS (Network Storage) build</a> — <a href=https://michael.stapelberg.ch/>Michael Stapelbergs Website</a><div>For over 10 years now, I run two self-built NAS (Network Storage) devices which serve media (currently via Jellyfin) and run daily backups of all my PCs and servers.
117In this article, I describe my goals, which hardware I picked for my new build (and why) and how I set it up.
118Design Goals
119I use my netw…</ul><p>Generated with <a href=https://git.sr.ht/~sircmpwn/openring target=_blank rel=noopener>openring</a>.</section><footer><hr><p><big><strong>Want to comment or have something to add?</strong></big><p>You can write me an email
120at <a href=mailto:mitja.felicijan@gmail.com>mitja.felicijan@gmail.com</a> or
121catch up with me <a href=https://telegram.me/mitjafelicijan target=_blank>on Telegram</a>.<hr><p>This website does not track you. Content is made available under the <a href=https://creativecommons.org/licenses/by/4.0/ target=_blank rel=noreferrer>CC BY 4.0 license</a> unless
122specified otherwise. Blog is also available as <a href=/index.xml target=_blank>RSS feed</a>.</footer><script>
123 window.va = window.va || function () { (window.vaq = window.vaq || []).push(arguments); };
124 </script><script defer src=/_vercel/insights/script.js></script> \ No newline at end of file