It's hard to say which is worse for fans to endure: A team struggling to score runs while pitching alright or a team hitting the ball but unable to consistently win because the pitching can't hold opponents down. As a fan, there is little you can do but look at the facts and try to figure out what is going to happen next based on what has happened in the past.
In the case of this year's team, most fans realize that there are a good number of players on offense who have yet to play up to their ability. But with every passing game that doesn't see some major breakout, more and more doubt creeps in that a breakout is coming. The frustration builds and people panic.
There is nothing for a fan to do but sit back and try not to be aggravated by the ride. Of course the players will worry, and work to make adjustments to achieve the turnaround. That turnaround will almost certainly come, because the players have shown in the past that they are better than they are currently playing. We all just have to wait for it, as annoying as that is.