Connectors and gateways are processes that run on the server. They both contend with Microsoft Exchange processes for resources on the server. These connectors and gateways communicate directly with the information store, which also creates contention for resources.
If a particular connector or gateway is causing performance problems, you can dedicate a computer to this connector or gateway, or add a second connector or gateway instance somewhere else in the site.