Speaking to the press on Thursday, Kalonzo accused Health Cabinet Secretary (CS) Aden Duale of spreading ethnic threats against the Kamba community, questioning his competence as a community and political leader.
"CS Duale, in Mandera said that we in the opposition should not be allowed to go past Tana River. He said so in Kisomali (Somali dialect) and we got the translation," he said.
"And no amount of tribal talk will come in between the two communities."
Kalonzo added that blame should be shifted to the bandits who attacked residents in Tseikuru, Kitui County, where seven people were killed.
"The criminals who executed the Kwa Kamari Massacre do not represent any community, they are criminals," he noted.
The Wiper boss had earlier alleged the attackers, believed to be members of a pastoralist community, had encroached into the Mwingi North Game Reserve and that tensions had been reported.
He therefore stated that the tussle should not be inter-community, and political leaders should work towards calming tensions instead of fuelling them.
"I must tell CS Duale even as he says we should not cross over there are so many Kambas residing in Garissa, and Mandera and other areas. Our Brothers from the pastoralist communities are not criminals but collaborate with authorities," he said.
"I also recommend elders to meet immediately, and I'm ready to rush there."
Meanwhile, CS Duale has called for an end to the violence plaguing the Garissa-Kitui border, urging local political leaders to actively promote peace and unity within their communities.
He also urged security forces to swiftly apprehend those responsible for recent killings and ensure they face the full force of the law.
"Peace is really expensive. I want the political leadership there to bring the communities together. Every community lives everywhere in our country," he said, addressing the press on Thursday.
"The security agencies should ensure that people who want to kill others are arrested and brought to book."
A heavy contingent of General Service Unit (GSU) officers and regular police has since been deployed to the area to restore order and prevent further attacks.