In this paper, a method for $H_\infty$ observer design for linear systems with multiple delays in state and output variables is proposed. The designing method involves attenuating of the disturbance to a pre-specified level. The observer design requires solving certain algebraic Riccati equation. An example is given in order to illustrate the proposed method.