Activision revealed that the Call of Duty player base preferred Skill-Based Matchmaking (SBMM). The game developer conducted an experiment to test a secret matchmaking method that lessened SBMM. Activision later revealed that most players in the experiment left the game, implying that SBMM was preferred.
Over the last few years, Skill-Based Matchmaking (SBMM) has become a topic of interest in the gaming world. The term has become popular among players, just like “Ray tracing.” However, while “Ray tracing” has often been considered positive, SBMM has experienced the converse, being heavily viewed negatively. However, following a recently concluded experiment, Activision revealed that Call of Duty players preferred SBMM over other matchmaking options.
Activision secretly conducts SBMM experiment
Activision is an American video game publisher famous for the Call of Duty games. The Call of Duty games are military-inspired shooter games that allow offline and online play. For years, Call of Duty games have utilized the Connection-Based Matchmaking system (CBMM). The connection-based approach relies on the player’s connection to pair them with the best match. However, the Connection-Based Matchmaking (CBMM) system was considered faulty as the system often grouped players with high skill levels with less skilled players. The use of the CBMM approach was swapped out for the SBMM system in 2007 to provide fairer matchmaking using the player’s skill levels.
Despite switching to a fairer system, some players were negatively vocal about the SBMM system in Call of Duty. In response, Activision launched a secret experiment to test the players’ preferences in Call of Duty: Modern Warfare 3. The experiment introduced a secret matchmaking system where the skill level used was lessened. Activision revealed that the change was implemented for 50% of the game’s population. After two weeks, the results revealed that 90% of the group had a lower return rate. The remaining 10% represented players of a higher skill level who returned to the game.
From the results, Activision concluded that a decrease in skill used would lead to fewer and fewer players engaging with the game. Activision stated that the trend would result in low and mid-skilled players not returning to the game. The outcome would result in bad experiences for all players. The publisher also concluded that the results showed that players preferred SBMM even if they did not know it.
Players react to Activision’s announced SBMM experiment results
After Activision made the results of the SBMM experiment public, players quickly joined the online debate. The SBMM experiment’s results elicited mixed reactions from players. Some players viewed the move as a positive for the game. SSGSentinel stated that using SBMM was a “win” since players with high skills would level up and match against players on their level.
“They do this every year, run ‘secret test’ then think those numbers are a representation of why people aren’t playing the game.”
– SoHJayknox
However, despite the findings, most players flocking to social media to add to the SBMM debate retained their negative attitude. Players such as SoHJayknox stated that the experiment was flawed and only used to justify Activision’s decision to use the SBMM system.
