In this passage, Gimpel’s anger toward Elka is supplanted by his feelings of love and forgiveness. He is simply not a resentful person at heart and finds it difficult to
want to shun her as he has been commanded to do. Further, even though it seems obvious that Elka is guilty (he saw the man in her bed with his own eyes), his trustfulness makes it very hard for him to confidently dismiss the repeated assertions by Elka and the other townspeople that she is innocent. His seemingly absurd supposition that he might have hallucinated the whole incident is a testament to how fearful Gimpel is that he might ever wrongly think badly of or accuse another person (especially someone he happens to love as much as he loves Elka). As far as he is concerned, it would be far better to be deceived than to do someone such injustice.