しつれいします
This phrase has two meaning.
The literal translation is "Please forgive my bad manner."

(1) I am leaving.
(2) Excuse me.

When you are leaving, you usually say おさきに　しつれいします。
"I am leaving now ... please forgive me for my bad manner."