RJ Barrett arrived back in the New York area with the Raptors on Friday evening, but he was unable to hook up with any of his former teammates