I understand your hesitation regarding the Observer rule.
I decided to ignore it most of the time because where I fly FPV, there is no tangible risk at all in not having one, and it's not a rule that I believe has ever, even once, been enforced in a typical recreational FPV situation.
I think it's one of the stupidest rules applied to FPV, created for good reasons for camera drones when out of VLOS like in professional uses inspecting bridges, buildings, etc., that sort of thing.
Weaving around trees where no one's around but you? The observer is useless, and adds no safety even if they have their eyes on the drone the whole time.
So, long way of saying it's the one rule I break with impunity, am ethically sound with it, and not worried I'm going to get in trouble.