Is position vector always told with respect to the origin ?

yes , position vector corresponds to the straight line joining the point to the origin
position vector represent the position of a point P in the space with reference to the origin.
position vector of P is $\overline{OP}$ .

hope this helps you