"I shall never be dangerous for you, Miss Rivers," he said gently