For me, I lose mainly to my close friends. Whenever I was playing against my friend's friends, I can actually beat them somewhat. When it comes to my close friends, not so much though I do win aganist them depending on which deck I use.
I remember when I was facing a friend of a friend, he didn't get any triggers during his drive check which is funny since I was using my incomplete MLB deck during that time (he still won btw). Other times I remember many of my friends never getting triggers whenever I played them, but sometimes they do.
The friend that introduced me into Vanguard is the person I generally lose to. Mainly because he generally gets more practice than me, because he has friends that come over to his house to practice while I have to count on going to my locals to get any practice.