If the devotee feels that, "I can be Krishna Conscious without the association of devotees." it is very dangerous situation. More we separate from devotees, more we bounded by the attacks of Maya. The material world is designed to struggle to exist. So, Srila Prabhupada made the situation minimum by having Krishna conscious temples, communities and farm projects, so devotees can live in association with devotees.
Association of saintly persons alone can bring us eternal peace and everlasting happiness and carry us across the ocean of birth, old age, disease and death.
When we keep our association with Krishna, every activity is proper and liberating, but if we disassociate ourselves from the Lord's mercy then like a hand which is severed from the body we become ugly and useless. — In his letter to Hrisikesa, 26th Nov, 1968.
When we associate with devotees we slowly-slowly get to know about their great qualities and thus we give up our envious nature.
In Chaitanya Caritamrta Lord Caitanya says that sadhu-sanga, the association of a great saintly person, is very important, because even if one is not advanced in knowledge, simply by association with a great saintly person one can immediately make considerable advancement in spiritual life.
A devotee should always aspire to live in the association of advanced devotees and engage in the service of the Lord through the parampara system.