The grey patches are likely lichen, a combination of a fungus and an algae. It is harmless to you and the tree. It is common ...