After Boone and Mingo have joined his caravan to help ensure safe transit of gold to the American war effort, Beaumarchais looks to his left as he's driving the wagon. Three or four times, looking to the left, he sees several red uniformed men on horseback, who he says are following them. Beaumarchais has looked to his left, and the men on horse are moving to the left of the screen, so, they would be traveling in the opposite direction, and hence, not following.