There is a lot of over interpreting going on here.
Couple points.
(1) You are in a suburb of Sydney AUS, and a lot of your recent play is against Lidcombe players. So even if you don't play, the system is constantly getting new information determining how Lidcombe matches up to other parts of Sydney, how Sydney matches up to the rest of Australia, and how Australia matches up to the rest of the world. In other words if Lidcombe players tend to not live up to the expectations from their ratings, the players who have all their play in Lidcombe might go down by 1.5 points. And if, say, a third of your games are against Lidcombe opponents, then you might go down half a point. This sort of thing is happening every day and is going on whether you play or not.
(2) You should not take the "performance" number in digitalpool very seriously. It tends to be more meaningful when you have many matches against many players with well established rating. You don't meet those criteria here. One of your opponents, Kay, had no information at all in Fargorate. And so games against Kay don't at this point affect your rating. If Kay plays more over the next several months, the system will start paying some attention to your wins against her. Of the other two players, one has an unestablished rating, and so the system will at this point weight the assessment of those games less. But if we ignore that, your two opponents, Milo and Dennis average about 500 and you won 6 games and lost 12 (won a third of the games). This is the expected number of wins of a player rated about 400.
Although I see the point about a lot of my recent opponents having provisional ratings too, so my 'high' performances haven't actually been as high as I had hoped.
