HELP: Authenticating with HackerNews

<p>I&#39;m trying to get my upvote information from HN, but their API doesn&#39;t support private user information, so I decided to try scraping; however, I can&#39;t seem to authenticate correctly (see my attempt here: <a href="https://gist.github.com/ns-cweber/20033179b75e3c0e301062c85b2d35e4" rel="nofollow">https://gist.github.com/ns-cweber/20033179b75e3c0e301062c85b2d35e4</a>). The login request returns 200, but passing the cookies to the /upvoted endpoint returns 39 bytes of non-HTML garbage (with http 200): sN/QH.�T(,q���. This also isn&#39;t the error message you get when auth fails--that is &#34;Cannot display that&#34; (try it yourself here: <a href="https://news.ycombinator.com/upvoted?id=dang&amp;comments=t" rel="nofollow">https://news.ycombinator.com/upvoted?id=dang&amp;comments=t</a>).</p> <p>I&#39;ve tried double and triple checking the headers against my browser and against curl, and I&#39;m confirming that the output is the same via httputil.DumpRequest. Still, my Go client is getting different data than curl or my browser.</p> <p>Could someone help me spot my error?</p> <hr/>**评论：**<br/><br/>xrstf: <pre><p>Your code works perfectly fine for me, assuming I&#39;m using the same username in both places (line 69 and 114). I receive a gzip blob that decodes to <code>&lt;html op=&#34;upvoted&#34;&gt;&lt;head&gt;&lt;meta name=&#34;referrer&#34; content=&#34;origin&#34;&gt;&lt;meta name=&#34;.....</code>.</p> <p>Maybe I did not understand your issue?</p></pre>weberc2: <pre><blockquote> <p><a href="https://gist.github.com/ns-cweber/20033179b75e3c0e301062c85b2d35e4" rel="nofollow">https://gist.github.com/ns-cweber/20033179b75e3c0e301062c85b2d35e4</a></p> </blockquote> <p>Maybe the &#34;non-HTML garbage&#34; I was receiving is simply gzipped HTML, and I was expecting the HTTP client to un-gzip it for me? I&#39;ll look into this when I get a moment. Thanks for taking the time to run it!</p></pre>xrstf: <pre><p>I&#39;ve just added a <code>ioutil.WriteFile(&#34;foo.gz&#34;, data, 0644)</code> at the end of <code>main</code> and took a look at the file. Before changing the username in the <code>upvoted</code> function, I received the &#34;Cannot display that&#34; gzip blob, after changing it, it worked as intended.</p></pre>weberc2: <pre><p>Yeah, gzip was the problem. Thanks very much.</p></pre>Thaxll: <pre><p>You ask for a gzip response with: values.Set(&#34;accept-encoding&#34;, &#34;gzip, deflate, br&#34;) in the client but the default Go http client doesn&#39;t support gzip response. Remove that header you will be fine.</p> <p>If you want to handle gzip response: <a href="https://github.com/NYTimes/gziphandler" rel="nofollow">https://github.com/NYTimes/gziphandler</a></p></pre>weberc2: <pre><p>Awesome, thanks!</p></pre>dchapes: <pre><blockquote> <p>but the default Go http client doesn&#39;t support gzip response</p> </blockquote> <p>This isn&#39;t accurate. If you don&#39;t provide your own &#34;Accept-Encoding&#34; header and if you don&#39;t override <code>http.Transport.DisableCompression</code> then the default <code>http.Transport</code> will add the header and transparently decompress the response.</p> <p>From <a href="https://golang.org/pkg/net/http#Transport.DisableCompression" rel="nofollow"><code>http.Transport.DisableCompression</code></a>:</p> <blockquote> <p>DisableCompression, if true, prevents the Transport from requesting compression with an &#34;Accept-Encoding: gzip&#34; request header when the Request contains no existing Accept-Encoding value. If the Transport requests gzip on its own and gets a gzipped response, it&#39;s transparently decoded in the Response.Body. However, if the user explicitly requested gzip it is not automatically uncompressed.</p> </blockquote></pre>