How to get the paci to stay in?

My boy is 3 weeks old. How are we getting the pacifier to actually stay in? He seems to like it at night when falling asleep but as soon as it falls out of his mouth it wakes him and the vicious cycle starts all over. The sleeping in the bassinet thing is not going well and the pacifier seems to help a little bit!