diff options
| author | Mitja Felicijan <mitja.felicijan@gmail.com> | 2023-10-29 14:41:39 +0100 |
|---|---|---|
| committer | Mitja Felicijan <mitja.felicijan@gmail.com> | 2023-10-29 14:41:39 +0100 |
| commit | 2836163e54e3b94342113314e70ee564c456c43e (patch) | |
| tree | 59b82fc69e83cc6d92846a8e9f510b0bb865cf3b /public/golang-profiling-simplified.html | |
| parent | d50ea4053ea04abb3a455606d4591a8283af0677 (diff) | |
| download | mitjafelicijan.com-2836163e54e3b94342113314e70ee564c456c43e.tar.gz | |
Added public folder to git so it get get deployed on vercel
Diffstat (limited to 'public/golang-profiling-simplified.html')
| -rwxr-xr-x | public/golang-profiling-simplified.html | 105 |
1 files changed, 105 insertions, 0 deletions
diff --git a/public/golang-profiling-simplified.html b/public/golang-profiling-simplified.html new file mode 100755 index 0000000..eaee274 --- /dev/null +++ b/public/golang-profiling-simplified.html | |||
| @@ -0,0 +1,105 @@ | |||
| 1 | <!doctype html><html lang=en-us><meta charset=utf-8><meta name=viewport content="width=device-width,initial-scale=1"><link href="data:image/x-icon;base64,AAABAAEAEBAAAAEAIABoBAAAFgAAACgAAAAQAAAAIAAAAAEAIAAAAAAAAAQAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAL69vf8AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAv76+/8LBwQkAAAAAAAAAAAAAAAC+vb3/AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAL+9vf/Bv78JAAAAAAAAAAAAAAAAu7q6/wAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAC7ubr/vr29CAAAAAAAAAAAy8nJAZ6foP8AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAnqGj/6GipAoAAAAAHLjU/xcXHf/BwsL/I8XY/yPK3v8XGiD/IbjL/yPF2f8XGiD/Fxkf/yLF2f8gnK3/Fxog/62ztv8fwNf/FRcd/x271v8mz93/GRsi/xkXHf8p097/GiIp/xobIv8p0t3/KdPe/xocIv8fYmr/KNPe/xoZH/8aHCL/J87c/xy81/8VFxz/IsPZ/8zS0/8XGiD/Ir/R/yPH2/8XGiD/Fxkf/yPH2/8dd4T/GBog/yPJ3f8jyNr/uru9/xcUGv8cudb/EhITDKi5vRKlvMP/RUpOERwcHRAdOj4QHTk8EBwdHRAdNTgQHTo/EBwcHRAcHB0QSGduEKW4vf+koqQfHzg+EBqz0ewSFRv7EyMr/xq51vsTERb7ExUb+xq41fsau9j7ExUb+xiPp/sZudb7ExUb+xMVG/sZuNX/GKvI/BIUGfMdvdn/IrfL/xcaIP8n1eb/J9Dh/xkcIf8ZGR7/J8/f/xxCSv8ZGyH/J9Dg/ybQ4P8ZHCL/FSQs/yPK3/8UExj/GE1b/ybS5P8ZGB7/Ghwj/ynW5P8p2Ob/Ghwi/yWrtv8p1eH/Ghwi/xocIv8p1uT/J8XT/xkcIv8m1un/Hb7d/xUYH/8hzOr/HtHu/xcaIf8XGB//I8vi/xgxOv8XGSD/I8rg/yPK4P8XGiD/GUFL/yPP6f8SERj/Fhkh/x3A4f8AAAAAJ2f9/ydr//8mZPH/AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAlYu38J2v//ydo/f8AAAAAAAAAAAd8/fkFqf//Iob8sAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAMY39awWr//8FfP3/AAAAAAAAAAAFm/7/SfD//wR+/f8AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAOB/f9B7v//BaX+/wAAAAAAAAAAQ878SAyZ/v9n1v4KAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAADu9v8DDJb+/z3N/XgAAAAA3/sAAN/7AADf+wAA3/sAAAAAAAAAAAAAAAAAAN/7AAAAAAAAAAAAAAAAAAAAAAAAj/EAAI/5AACP8QAA3/sAAA==" rel=icon type=image/x-icon><title>Golang profiling simplified</title><meta name=description content="Many posts have been written regarding profiling in Golang and I haven’t foundproper tutorial regarding this."><link rel=alternate type=application/rss+xml title="Mitja Felicijan's posts" href=https://mitjafelicijan.com/index.xml><link rel=alternate type=application/rss+xml title="Mitja Felicijan's notes" href=https://mitjafelicijan.com/notes.xml><style>body{padding:1rem;max-width:760px;background:#fff;font-family:sans-serif;line-height:1.35rem;font-size:16px;margin:0 auto}hr{margin-block-start:1.5rem}h1,h2,h3{line-height:initial}h1{font-size:xx-large}footer{margin-block-start:2rem}cap{text-transform:capitalize}table{max-width:100%;width:100%;border-collapse:separate;border-spacing:2px;border:1px solid #000;border-left:1px solid #999;border-top:1px solid #999}blockquote{font-style:italic}table thead{background:#eee}ul.list li{padding:.2em 0}ul{line-height:1.4em}td,th{border:1px solid #000;padding:4px;border-right:1px solid #999;border-bottom:1px solid #999;text-align:left}pre{text-wrap:nowrap;overflow-x:auto;padding:0 1em;border:1px solid #dcdcdc}code{padding:0 3px;font-size:14px;border:0}pre code{line-height:1.3em}pre,code,pre *,code *{font-family:monospace}figure{margin-inline-start:0;margin-inline-end:0}figcaption{text-align:center}figcaption p{margin:.3em 0 0}img,video,audio{max-width:100%}header{display:flex;flex-direction:row;gap:3rem}nav{display:flex;gap:.75rem}nav.main{flex-grow:1}.pstatus-orange{background:gold}.pstatus-green{background:#9acd32}.pstatus-red{background:#cd5c5c}@media only screen and (max-width:600px){body{padding:15px}header{flex-direction:column;gap:1rem}a{word-wrap:break-word}}</style><header><nav class=main itemscope itemtype=http://schema.org/SiteNavigationElement role=toolbar><a href=/>Home</a> | ||
| 2 | <a href=https://git.mitjafelicijan.com/ target=_blank>Git</a> | ||
| 3 | <a href=https://files.mitjafelicijan.com/ target=_blank>Files</a> | ||
| 4 | <a href=/radio.pls target=_blank>Radio</a> | ||
| 5 | <a href=/mitjafelicijan.pgp.pub.txt target=_blank>PGP</a> | ||
| 6 | <a href=/curriculum-vitae.html>CV</a> | ||
| 7 | <a href=/index.xml target=_blank>RSS</a></nav></header><main role=main><article itemtype=http://schema.org/Article><h1 itemtype=headline>Golang profiling simplified</h1><p><cap>post</cap>, Mar 7, 2017 on <a href=https://mitjafelicijan.com>Mitja Felicijan's blog</a><div><p>Many posts have been written regarding profiling in Golang and I haven’t found | ||
| 8 | proper tutorial regarding this. Almost all of them are missing some part of | ||
| 9 | important information and it gets pretty frustrating when you have a deadline | ||
| 10 | and are not finding simple distilled solution.<p>Nevertheless, after searching and experimenting I have found a solution that | ||
| 11 | works for me and probably should also for you.<h2 id=where-are-my-pprof-files>Where are my pprof files?</h2><p>By default pprof files are generated in /tmp/ folder. You can override folder | ||
| 12 | where this files are generated programmatically in your golang code as we will | ||
| 13 | see below in example.<h2 id=why-is-my-cpu-profile-empty>Why is my CPU profile empty?</h2><p>I have found out that sometimes CPU profile is empty because program was not | ||
| 14 | executing long enough. Programs, that execute too quickly don’t produce pprof | ||
| 15 | file in my cases. Well, file is generated but only contains 4KB of information.<h2 id=profiling>Profiling</h2><p>As you can see from examples we are executing dummy_benchmark functions to | ||
| 16 | ensure some sort of execution. Memory profiling can be done without such a | ||
| 17 | “complex” function. But CPU profiling needs it.<p>Both memory and CPU profiling examples are almost the same. Only parameters in | ||
| 18 | main function when calling profile.Start are different. When we set | ||
| 19 | profile.ProfilePath(“.”) we tell profiler to store pprof files in the same | ||
| 20 | folder as our program.<h3 id=memory-profiling>Memory profiling</h3><pre tabindex=0 style=background-color:#fff><code><span style=display:flex><span><span style=color:#00f>package</span> main | ||
| 21 | </span></span><span style=display:flex><span> | ||
| 22 | </span></span><span style=display:flex><span><span style=color:#00f>import</span> ( | ||
| 23 | </span></span><span style=display:flex><span> <span style=color:#a31515>"fmt"</span> | ||
| 24 | </span></span><span style=display:flex><span> <span style=color:#a31515>"time"</span> | ||
| 25 | </span></span><span style=display:flex><span> <span style=color:#a31515>"github.com/pkg/profile"</span> | ||
| 26 | </span></span><span style=display:flex><span>) | ||
| 27 | </span></span><span style=display:flex><span> | ||
| 28 | </span></span><span style=display:flex><span><span style=color:#00f>func</span> dummy_benchmark() { | ||
| 29 | </span></span><span style=display:flex><span> | ||
| 30 | </span></span><span style=display:flex><span> fmt.Println(<span style=color:#a31515>"first set ..."</span>) | ||
| 31 | </span></span><span style=display:flex><span> <span style=color:#00f>for</span> i := 0; i < 918231333; i++ { | ||
| 32 | </span></span><span style=display:flex><span> i *= 2 | ||
| 33 | </span></span><span style=display:flex><span> i /= 2 | ||
| 34 | </span></span><span style=display:flex><span> } | ||
| 35 | </span></span><span style=display:flex><span> | ||
| 36 | </span></span><span style=display:flex><span> <-time.After(time.Second*3) | ||
| 37 | </span></span><span style=display:flex><span> | ||
| 38 | </span></span><span style=display:flex><span> fmt.Println(<span style=color:#a31515>"sencond set ..."</span>) | ||
| 39 | </span></span><span style=display:flex><span> <span style=color:#00f>for</span> i := 0; i < 9182312232; i++ { | ||
| 40 | </span></span><span style=display:flex><span> i *= 2 | ||
| 41 | </span></span><span style=display:flex><span> i /= 2 | ||
| 42 | </span></span><span style=display:flex><span> } | ||
| 43 | </span></span><span style=display:flex><span>} | ||
| 44 | </span></span><span style=display:flex><span> | ||
| 45 | </span></span><span style=display:flex><span><span style=color:#00f>func</span> main() { | ||
| 46 | </span></span><span style=display:flex><span> <span style=color:#00f>defer</span> profile.Start(profile.MemProfile, profile.ProfilePath(<span style=color:#a31515>"."</span>), profile.NoShutdownHook).Stop() | ||
| 47 | </span></span><span style=display:flex><span> dummy_benchmark() | ||
| 48 | </span></span><span style=display:flex><span>} | ||
| 49 | </span></span></code></pre><h3 id=cpu-profiling>CPU profiling</h3><pre tabindex=0 style=background-color:#fff><code><span style=display:flex><span><span style=color:#00f>package</span> main | ||
| 50 | </span></span><span style=display:flex><span> | ||
| 51 | </span></span><span style=display:flex><span><span style=color:#00f>import</span> ( | ||
| 52 | </span></span><span style=display:flex><span> <span style=color:#a31515>"fmt"</span> | ||
| 53 | </span></span><span style=display:flex><span> <span style=color:#a31515>"time"</span> | ||
| 54 | </span></span><span style=display:flex><span> <span style=color:#a31515>"github.com/pkg/profile"</span> | ||
| 55 | </span></span><span style=display:flex><span>) | ||
| 56 | </span></span><span style=display:flex><span> | ||
| 57 | </span></span><span style=display:flex><span><span style=color:#00f>func</span> dummy_benchmark() { | ||
| 58 | </span></span><span style=display:flex><span> | ||
| 59 | </span></span><span style=display:flex><span> fmt.Println(<span style=color:#a31515>"first set ..."</span>) | ||
| 60 | </span></span><span style=display:flex><span> <span style=color:#00f>for</span> i := 0; i < 918231333; i++ { | ||
| 61 | </span></span><span style=display:flex><span> i *= 2 | ||
| 62 | </span></span><span style=display:flex><span> i /= 2 | ||
| 63 | </span></span><span style=display:flex><span> } | ||
| 64 | </span></span><span style=display:flex><span> | ||
| 65 | </span></span><span style=display:flex><span> <-time.After(time.Second*3) | ||
| 66 | </span></span><span style=display:flex><span> | ||
| 67 | </span></span><span style=display:flex><span> fmt.Println(<span style=color:#a31515>"sencond set ..."</span>) | ||
| 68 | </span></span><span style=display:flex><span> <span style=color:#00f>for</span> i := 0; i < 9182312232; i++ { | ||
| 69 | </span></span><span style=display:flex><span> i *= 2 | ||
| 70 | </span></span><span style=display:flex><span> i /= 2 | ||
| 71 | </span></span><span style=display:flex><span> } | ||
| 72 | </span></span><span style=display:flex><span>} | ||
| 73 | </span></span><span style=display:flex><span> | ||
| 74 | </span></span><span style=display:flex><span><span style=color:#00f>func</span> main() { | ||
| 75 | </span></span><span style=display:flex><span> <span style=color:#00f>defer</span> profile.Start(profile.CPUProfile, profile.ProfilePath(<span style=color:#a31515>"."</span>), profile.NoShutdownHook).Stop() | ||
| 76 | </span></span><span style=display:flex><span> dummy_benchmark() | ||
| 77 | </span></span><span style=display:flex><span>} | ||
| 78 | </span></span></code></pre><h3 id=generating-profiling-reports>Generating profiling reports</h3><pre tabindex=0 style=background-color:#fff><code><span style=display:flex><span><span style=color:green># memory profiling</span> | ||
| 79 | </span></span><span style=display:flex><span>go build mem.go | ||
| 80 | </span></span><span style=display:flex><span>./mem | ||
| 81 | </span></span><span style=display:flex><span>go tool pprof -pdf ./mem mem.pprof > mem.pdf | ||
| 82 | </span></span><span style=display:flex><span> | ||
| 83 | </span></span><span style=display:flex><span><span style=color:green># cpu profiling</span> | ||
| 84 | </span></span><span style=display:flex><span>go build cpu.go | ||
| 85 | </span></span><span style=display:flex><span>./cpu | ||
| 86 | </span></span><span style=display:flex><span>go tool pprof -pdf ./cpu cpu.pprof > cpu.pdf | ||
| 87 | </span></span></code></pre><p>This will generate PDF document with visualized profile.<ul><li><a href=/posts/go-profiling/golang-profiling-mem.pdf>Memory PDF profile example</a><li><a href=/posts/go-profiling/golang-profiling-cpu.pdf>CPU PDF profile example</a></ul></div></article></main><section><hr><h2>Posts from blogs I follow around the net</h2><ul><li><a href=https://chotrin.org/writing/2023-10-20.html target=_blank rel=noopener>OpenBSD upgrade and fall things.</a><div>Been AFK for a bit. It's autumn and I upgraded this server to OpenBSD 7.4! — <a href=https://chotrin.org>chötrin's wiki.</a><li><a href=https://mirzapandzo.com/next-image-url-parameter-is-valid-but-upstream-response-is-invalid target=_blank rel=noopener>Next/Image "url" parameter is valid but upstream response is invalid</a><div>Getting "url" parameter is valid but upstream response is invalid error with Next/Image on WSL2 — <a href=https://mirzapandzo.com/>Mirza Pandzo's Blog</a><li><a href=https://drewdevault.com/2023/10/13/Going-off-script.html target=_blank rel=noopener>Going off-script</a><div>There is a phenomenon in society which I find quite bizarre. Upon our entry to | ||
| 88 | this mortal coil, we are endowed with self-awareness, agency, and free will. | ||
| 89 | Each of th… — <a href=https://drewdevault.com>Drew DeVault's blog</a><li><a href=https://solar.lowtechmagazine.com/2023/10/workshop-in-rotterdam-how-to-build-a-bike-generator/ target=_blank rel=noopener>Workshop in Rotterdam: How to Build a Bike Generator</a><div>Afbeelding: Low-tech Magazine workshop in Rotterdam, the Netherlands. Poster: Marie Verdeil. Image: Sara Vercauteren | ||
| 90 | The workshop takes place on behalf of the “Hou… — <a href=https://solar.lowtechmagazine.com/posts/>LOW←TECH MAGAZINE English</a><li><a href="http://offbeatpursuit.com:80/blog/?id=24" target=_blank rel=noopener>Printf debugging</a><div>tags: | ||
| 91 | plan9 | ||
| 92 | There’s no shame in that. Yes, there is documentation, code to be | ||
| 93 | read, and debuggers to be used. But sometimes you just need to “see” | ||
| 94 | what is happening. | ||
| 95 | So… — <a href=http://offbeatpursuit.com:80/blog/>WLOG - blog</a><li><a href=https://neil.computer/notes/chart-of-accounts-for-startups-and-saas-companies/ target=_blank rel=noopener>Chart of Accounts for Startups and SaaS Companies</a><div>Accounting is fundamental to starting a business. You need to have a basic understanding of accounting principles and essential bookkeeping. I had to learn it. Ther… — <a href=https://neil.computer/>Neil Panchal</a><li><a href=https://journal.valeriansaliou.name/deploy-a-nomad-cluster-on-alpine-linux-with-vultr/ target=_blank rel=noopener>Deploy a Nomad Cluster on Alpine Linux with Vultr</a><div>After spending countless hours trying to understand how to deploy my apps on Kubernetes for the first time to host Mirage, an AI API service that I run, I ended up … — <a href=https://journal.valeriansaliou.name/>Valerian Saliou</a><li><a href=https://jcs.org/2023/10/17/wikipedia target=_blank rel=noopener>Wikipedia Reader 1.0 Released</a><div>Wikipedia Reader | ||
| 96 | 1.0 has been released: | ||
| 97 | wikipedia-1.0.sit | ||
| 98 | (StuffIt 3 archive, includes | ||
| 99 | source code | ||
| 100 | and THINK C 5 project file) | ||
| 101 | SHA256: 360e12d064f6579695f1e627ce34cb2f0… — <a href=https://jcs.org/>joshua stein</a></ul><p><a href=https://git.sr.ht/~sircmpwn/openring>Generated with openring.</a></section><footer><hr><p><big><strong>Want to comment or have something to add?</strong></big><p>You can write me an email | ||
| 102 | at <a href=mailto:m@mitjafelicijan.com>m@mitjafelicijan.com</a> or | ||
| 103 | catch up with me <a href=https://telegram.me/mitjafelicijan target=_blank>on Telegram</a>.<hr><p>This website does not track you. Content is made available under | ||
| 104 | the <a href=https://creativecommons.org/licenses/by/4.0/ target=_blank rel=noreferrer>CC BY 4.0 license</a> unless specified | ||
| 105 | otherwise. Blog is also available as <a href=/index.xml target=_blank>RSS feed</a>.</footer> \ No newline at end of file | ||
