Why does a physicist not have the moral right to work on the practical application of atomic energy?

why does a physicist not have the right to work on the practical applications of atomic theory? What are some key reasons and you know why is it detrimental to society (atomic bomb and stuff)