This is totally not my genre. I don't know what genre it is, actually. Have no idea. It's intriguing. The first word that came to my mind while listening to it was "beatnik". It reminded me of the poetry readings (like open mic, except for reading or reciting original poetry), where the audience would snap their fingers instead of applauding if they liked it. I never experienced this in person, but I read about it and saw it in a movie or two.
I think you can make this work with more effort. Sounds like you're going to take a break from it, which may help to recharge your battery and bring you fresh insights for continuing the struggle. I don't have any specific suggestions. As you are already aware, it needs work on the timing and bringing the parts together. Right now it sounds very experimental with disjointed or disconnected sounds not really meshing into a unified whole.