could the rabbit thing be because it’s being held incorrectly or in a way which is scary?

Maybe. Rabbits don’t actually like being held, aside from a few odd individuals. If you have to hold a rabbit, support all the feet. If you can avoid it, don’t hold the bun. Let the bun climb on your lap, or leave the bun on the floor.