There is compromise, although it's up for debate on who should do the compromising and under what circumstances. If you know you're going to be reading Finnegans Wake, you must expect to be in for a mindfuck - but I don't believe in confusing the audience for the sake of confusion.

The Unconsoled by Kazuo Ishiguro is a proper mindfuck as well, but it serves a real purpose, the reader is supposed to be thrown off guard and confused. I wouldn't want him to compromise one sentence for the sake of clarity because it would completely ruin his intention.

But there is an art to the thing. I think writing in an unconventional manner requires a great deal of skill in leading the reader where you want them to go without throwing them completely off track.