Yea, an HA Proxy would make a lot of sense with something like this. As you scale up the number of Interference services for SD, you can increase the number of background workers that are available on the Ruby side to take advantage of the additional servers. You can probably set up HA Proxy to balance the load which would help simplify the infrastructure. By default, I think it does Round Robin which would route each task to a different server in turns.