By “association rights” I infer that you mean the right of free association.
If so, can you be a little bit more specific as to whose “association rights”, specifically, are a more important issue than the right of trans folk to get healthcare, be free from discrimination, and be able to play sports without being harassed?
My inclination is that the most important targets to defend against facist oppression are the ones being targeted, which does suggest one plausible answer, but I really do want to know what you meant in your post.
Godwin himself pointed out that his law doesnt apply when discussing actual fascists.