Can FreeSWITCH accept a BYE message outside of a SIP dialog?

I have a trunk with five9 and using their third party transfer to bridge in an AI agent. When 
the AI agent disconnects the call on my end does not hang up. SIP traces show that I do receive
the bye but it is outside of the current SIP dialoge so it is currently ignored.