The man was arrested shortly after allegedly attacking a congregant two weeks ago.