During the "Behind the Scenes of Banjo Kazooie" video in Rare Replay, the developers revealed that the decision to do garbled noises for each of the characters rather than full voice acting was due to time constraints, since recording so much dialogue would have greatly increased the development period of the games.
Contributed by CuriousUserX90