unless you’re <56Kbps, your upload speed does not matter for this game (and most of the problems of being <56Kbps result from PSN or XBL not having sufficient bandwidth to work with)
running netflix, youtube, torrents, etc will mess with your connection if you don’t put a cap on the bandwidth they use (relative to your download and upload speeds.) some isps will start to prioritize traffic (slower for you) if you so much as run netflix or any torrents and won’t stop just because you close them (they will eventually, but it can take up to a full day.) older - as well as cheaper - modems and routers often struggle to handle the amount of connections modern computers make, so try to confirm this isn’t a problem (can be difficult to diagnose.)
ping is almost irrelevant (for SFIV.) many networks (configured properly or otherwise) will reject ping requests, handle repeated pings poorly, or limit the amount of responses. the amount of requests performed and the bars given to rate their response time is pretty meh too, so a lot of connections will display as green but not reveal that they do not have a consistent connection or have a connection that only works as initially rated for a limited time. plus capcom screwed up in a couple of places (searching games will sometimes cache the ping results for no particular reason, in game rating is different from menu rating, rating update frequency in game is pretty slow, green threshold set waaay too high to give the appearance of better online…)
can’t do anything about other people running shit (and you can’t tell most of the time, either.) most people can’t even be assed to learn how to forward ports.