The only directory to cleanup is cls.tmpdir. So make it simple, without class property cleanup_paths, which for some reason didn't wasn't emptied in tearDownClass.