https://runbooks.safetywing.dev/runbooks/environment/Recent content in Environment on SafetyWing RunbooksHugoen-ushttps://runbooks.safetywing.dev/runbooks/environment/environmenthigh5xxrate/Mon, 01 Jan 0001 00:00:00 +0000https://runbooks.safetywing.dev/runbooks/environment/environmenthigh5xxrate/<h2 id="meaning">Meaning<a class="anchor" href="#meaning">#</a></h2> <p>The 5xx error ratio for a single environment exceeded its configured threshold. This is an environment-tier SLO alert emitted per environment by the <code>safetywing-environment</code> chart, scoped to that environment&rsquo;s application services.</p> <p>Fires when: the environment&rsquo;s 5xx ratio crosses the threshold while traffic is above a minimum RPS floor (the <code>minRps</code> guard avoids alerting on noise at low traffic).</p> <div class="highlight"><pre tabindex="0" style="color:#f8f8f2;background-color:#272822;-moz-tab-size:4;-o-tab-size:4;tab-size:4;-webkit-text-size-adjust:none;"><code class="language-promql" data-lang="promql"><span style="display:flex;"><span><span style="color:#75715e"># hetzner / Traefik form</span> </span></span><span style="display:flex;"><span><span style="color:#66d9ef">sum</span><span style="color:#f92672">(</span><span style="color:#66d9ef">rate</span><span style="color:#f92672">(</span>traefik_service_requests_total{service<span style="color:#f92672">=~</span>&#34;<span style="color:#e6db74">safetywing-&lt;env&gt;-applications-.*</span>&#34;,code<span style="color:#f92672">=~</span>&#34;<span style="color:#e6db74">5..</span>&#34;}[<span style="color:#e6db74">5m</span>]<span style="color:#f92672">))</span> </span></span><span style="display:flex;"><span> <span style="color:#f92672">/</span> <span style="color:#66d9ef">sum</span><span style="color:#f92672">(</span><span style="color:#66d9ef">rate</span><span style="color:#f92672">(</span>traefik_service_requests_total{service<span style="color:#f92672">=~</span>&#34;<span style="color:#e6db74">safetywing-&lt;env&gt;-applications-.*</span>&#34;}[<span style="color:#e6db74">5m</span>]<span style="color:#f92672">))</span> <span style="color:#f92672">&gt;</span> <span style="color:#f92672">&lt;</span>ratio<span style="color:#f92672">&gt;</span> </span></span><span style="display:flex;"><span><span style="color:#f92672">and</span> </span></span><span style="display:flex;"><span><span style="color:#66d9ef">sum</span><span style="color:#f92672">(</span><span style="color:#66d9ef">rate</span><span style="color:#f92672">(</span>traefik_service_requests_total{service<span style="color:#f92672">=~</span>&#34;<span style="color:#e6db74">safetywing-&lt;env&gt;-applications-.*</span>&#34;}[<span style="color:#e6db74">5m</span>]<span style="color:#f92672">))</span> <span style="color:#f92672">&gt;</span> <span style="color:#f92672">&lt;</span>minRps<span style="color:#f92672">&gt;</span></span></span></code></pre></div><p>On GKE environments the ingress is <strong>nginx</strong>, so the source metric differs:</p>