Yes - by the book it is, in what is called 'primitive wilderness areas' and maybe even 'wilderness areas'.
When you pack your bag, put your chalk bag in the bottom of the pack in a bag labelled 'Milk Powder'.
Similarly, put your pegs in a bag labelled "Vitamins : Iron".
Your hammer is for protection against Basut's because you are not allowed a gun.
Your power drill, snugly packed at the bottom of the bag is used to recharge your torch batteries.
But the likelihood of anyone ever checking is 10 000/1. I have never heard of this happening.
I went to a meeting with the Ezemvelo KZN when they were formulating their policy. It is rather complex, and they did not really know what climbing was all about, but in effect changes nothing in what we do, excepty some shiny rap anchors of some trade routes within the wilderness areas.
Also, bear in mind that chalky hands make it harder to grip grass.