Caller ID is a function provide by your network provider. Please contact your network provider on how to disable this function permanently.
Possibly you network provider will provide you wit a dial code to enter once you pick up the receiver handle. Sometimes this also can be done via phone menu or through login to your online account via web-browser.