Brexit secretary refuses to give evidence to Parliament