<p>I need fast reverse DNS lookups for my distributed crawler.</p>
<p>So, I wrote this in Go: <a href="https://github.com/zero-master/fastresolv" rel="nofollow">https://github.com/zero-master/fastresolv</a></p>
<p>Currently, using 1500 lookups/sec on 2 servers behind a load balancer (1 CPU and 1GB ram each) with 1 Redis server.</p>
<p>Looking for some feedback or pull requests. Thank you :)</p>
<hr/>**评论：**<br/><br/>Xeoncross: <pre><p>So because you're using redis instead of BoltDB or an internal cache pool of some sort I assume you expect multiple fastresolv instances to be spun up?</p></pre>zeromint: <pre><p>Hey! Yes, I have this in auto-scaling configuration. Since I send requests to multiple resolvers, it expect it to get chocked at some point. I've it running in auto scaling configuration, one Redis instance can consume a lot of requests, so it is not be a bottleneck in my setup.</p></pre>jasonbx: <pre><blockquote>
<p>1500 lookups/sec</p>
</blockquote>
<p>So you add a cache for your dns look ups and it gives you 1500 lookups/sec. Does it have anything to do with Go?</p></pre>epiris: <pre><p>Yes, it’s written in Go. Does your comment have anything to do with feedback about the new software the author is excited about?</p></pre>
