Getting to the Left Side of the Swingarm?

Hi everyone!
Highdesert here with another dumb question.
I need to replace the end cap on the left side of the swingarm cradle. I lost the original a few years ago and stuck a cork in there "for now".
The time has come to pull the cork out and .......order the right part including the right cap and the long finely threaded bolt!
Can I get to that area by removing the Z plate, or does the entire primary have to come off?
thanks!

The primary has to come off, the plate is very close to the cover.

Not what I wanted to hear, but thanks Kommando!