I had the great fortune of having a near endless supply of people crazy enough and willing to go out on the water with me, almost all without any prior experience on their part. The only ones I've really disappointed were some friends who keep visiting during a time of year with fluky and feeble winds. Every time we ended up being becalmed.
When it comes to sailing with people who are experienced, the first thing you'll find that everybody has different experience. It's really not the case that there is some single, linear or logarithmic scale of "sailing expertise" and you can sort everyone along that line as by height. You may already know things about your boat, or your lake, that even a pretty good sailor used to different conditions doesn't know as well.
A few years after I bought my very first sailboat (not a DS, about 1/2 the size), I suggested to someone who had sailed on yachts on the West Coast of Scotland (not the world's tamest sailing area) to take out my little boat. She and another guy promptly capsized it less than 30' from shore (in a gentle 5 knot breeze). Her experience didn't translate, because it most likely it involved letting the keel worry about keeping the boat upright and the skipper worry about setting the parameters like sail plan, trim and course.
So she (and the other guy) did something that I didn't think was "possible" because I, as a rank beginner, had never managed it.
Now, when I sail with people, I always casually "interview" them, to find out what they have done, where and when. I also pay close attention to how quickly they "get" how a DS is set up (even similar sized boats may have rather different ways to right halyards, sheets or center board). Or I solicit advice on sail trim. Like a good magician, I may or may not use their suggestions.
Over the years, I learned a lot from others that are more experienced (or that had different experience and therefore a different take on things). I've also made the space to let people new to sailing contribute whatever came naturally to them. (This includes kids and teens). Some were content to be passengers, some quickly got the tiller, others were happier to be "in charge" of the jib sheets. I usually position myself so that I can switch to "single-handing" at a moment's notice...
You've reached a point where you've peeled the first layer of this particular onion. That doesn't mean you don't get to learn from others any more (quite the contrary, much more of what you hear and read will actually make sense from now on), but it does mean that the chance that a random acquaintance will be able to sail your boat on your lake better than you can, in all circumstances, has gotten a lot smaller. So, no need to be apologetic any longer. You'll always politely demur and protest that you really barely now starboard from centerboard, while demonstrating to your passenger that you are quite capable of getting your boat to do what you want it to. If they are up to it, let them take the tiller, watch what they are doing, ask them their suggestions on sail trim if they do seem experienced, but be ready to lean in and take over, should their experience not translate to what's needed to handle your boat safely.