Defence Minister Israel Katz vowed on Tuesday that Israel would remain in Gaza and pledged to establish outposts there, but his office swiftly downplayed the remarks made at a settlement in the occupied West Bank.