Python is pain to do this in...is it possible to do a lot of http requests easily in GO? With something similar to multiprocessing in GO?
评论：
lolis5:
Redundancy_:Short answer is "very yes". The core net/http library uses goroutines for request handling, which allows for handling multiple requests simultaneously.
Multiprocessing, at least as you know it in python, isn't really a thing in go, but that's because it would introduce unnecessary overhead.
In Python, (cpython specifically) multi-threading is not very useful in most cases because only one thread may be running interpreted python code at a time because of a global interpreter lock. Python gets around this bottleneck by introducing multiple processes, each with its own interpreter lock.
In go, there is no equivalent concept. Goroutines can take full advantage of multiple processors and the language itself is responsible for scheduling them. They are similar to os threads in concept, but are much lighter weight.(Almost identical to the concept of fibers on Windows).
Hope this helps.
tmornini:It's worth going through the tour of Go. Concurrency part 10 Exercise covers a webcrawler that does concurrent http requests: https://tour.golang.org/concurrency/10
Also: http://blog.narenarya.in/concurrent-http-in-go.html https://matt.aimonetti.net/posts/2012/11/27/real-life-concurrency-in-go/
Synchronous is easy, and slow, in every language.
What you're looking for is asynchronous.
Go excels at asynchronous workloads.
Take a look at goroutines and channels.
