Sky door bell not secure in back plate

[Andy+Cap]

Even though the sky door bell clicks when I place it into the base plate I can easily remove without the key and I'm scared it may fall and smash or be stolen.Any ideas how I can make it more secure?

[Stottie]

Have you definitely clicked the little clip underneath? I tried to remove mine without undoing the little clip, and I couldn't remove it!

[Andy+Cap]

Yes it's clipping, you can hear the noise it makes when clicking in but I can just  pull the doorbell out.