Hey mate, welcome to the forum.
Now I don't much about drummers anxiety per-say, but I've had experience general anxiety, so I might have some advice for ya.
I probably don't need to tell you that the more frustrated you get at doing something the harder it gets, right.
So, if you find yourself getting bogged down with technique and rudiments, then take a break and reconnect with your joy of the kit. When I want to have a truly enjoyable drumming experience is pick a new song that's in my skill range (or slightly above) and get just thrash it out until I get it right. Don't worry about technique at first, just really get into the groove of it and add my own flair.
This helps me to learn new beats, fills, structures and so on, at my own pace and you don't have to sweat about what the metronome's doing the whole time.
Buy all means, keep doing your stick work and get those fingers loosened, but remember, you do this have fun.
Good luck bro and let us know how you get on.
