Victory fans may be banned