The family taking care of Bishop Castle returned on Wednesday after the Aspen Acres Fire got within 300 feet of it.