Hi There, I just took my rear door panel off last night to fix the door lock, so i found the same problem you have. With the handle trim cover removed, I inserted a slim screwdriver down into the handle and pushed it hard, while at the same time my other hand pulled the handle away from the door panel. It popped off easy enough. you can push the handle back on without the screwdriver, when finished.... cheers Ger C.