Hardness of computing width parameters based on branch decompositions over the vertex set