It is possible to take down Agent Smith without a wall kick, even if temporarily. First, scoot back so he does not throw you, then equip any gun and fire. At the same time, go into Focus and while he is dodging the bullets you just fired, run in then punch or kick him until he goes down. Kicks are recommended because they are more powerful. Then, get out of there while still using Focus. When you are out of harms way, let off the Focus. Note: Doing this in cramped spaces such as hallways is not recommended unless absolutely necessary.