Go newbie (1500 lookups/sec) looking for feedback

blov · · 257 次点击    
这是一个分享于 的资源,其中的信息可能已经有所发展或是发生改变。
<p>I need fast reverse DNS lookups for my distributed crawler.</p> <p>So, I wrote this in Go: <a href="https://github.com/zero-master/fastresolv" rel="nofollow">https://github.com/zero-master/fastresolv</a></p> <p>Currently, using 1500 lookups/sec on 2 servers behind a load balancer (1 CPU and 1GB ram each) with 1 Redis server.</p> <p>Looking for some feedback or pull requests. Thank you :)</p> <hr/>**评论:**<br/><br/>Xeoncross: <pre><p>So because you&#39;re using redis instead of BoltDB or an internal cache pool of some sort I assume you expect multiple fastresolv instances to be spun up?</p></pre>zeromint: <pre><p>Hey! Yes, I have this in auto-scaling configuration. Since I send requests to multiple resolvers, it expect it to get chocked at some point. I&#39;ve it running in auto scaling configuration, one Redis instance can consume a lot of requests, so it is not be a bottleneck in my setup.</p></pre>jasonbx: <pre><blockquote> <p>1500 lookups/sec</p> </blockquote> <p>So you add a cache for your dns look ups and it gives you 1500 lookups/sec. Does it have anything to do with Go?</p></pre>epiris: <pre><p>Yes, it’s written in Go. Does your comment have anything to do with feedback about the new software the author is excited about?</p></pre>

入群交流(和以上内容无关):加入Go大咖交流群,或添加微信:liuxiaoyan-s 备注:入群;或加QQ群:692541889

257 次点击  
加入收藏 微博
添加一条新回复 (您需要 登录 后才能回复 没有账号 ?)
  • 请尽量让自己的回复能够对别人有帮助
  • 支持 Markdown 格式, **粗体**、~~删除线~~、`单行代码`
  • 支持 @ 本站用户;支持表情(输入 : 提示),见 Emoji cheat sheet
  • 图片支持拖拽、截图粘贴等方式上传