
NECTAC conducts ongoing evaluation activities to determine the immediate
and longer term outcomes of NECTAC TA. Examples of reported outcomes are documented in
internal and external evaluation reports including the
3+2 Evaluation Report
(PDF: 228kb) ,
External Evaluation Report
(PDF: 244kb) , sample
Conference report
(PDF: 176kb) ,
NECTAC Evaluation Highlights: Client Feedback March 2009 - March 2010
(PDF: 722kb) ,
Annual Performance Report Summary - March 2010
(PDF: 716kb) , and
NECTAC Evaluation Highlights: Client Feedback September 2006 - October 2009
(PDF: 252kb) .
Immediate outcomes of TA are enhanced stakeholder capacity, meaning that participants develop or increase their capacity through increased awareness, knowledge, skills; means to access information/ resources; enhanced collaborative relationships; enhanced morale/ motivation; and the development of action plans. For all Major TA services and a randomly selected twenty percent of less extensive TA, the immediate outcomes are evaluated on a 1-5 Likert rating scale.
Improved State and Local Infrastructure is a longer term outcome of TA, meaning that Part C and Section 619 administrators use what they learned from TA to develop new or enhance existing policies, guidelines, procedures and interagency agreements to support full implementation of IDEA. The areas of state system level changes may relate to such areas as collaborative public awareness and child find, general supervision and monitoring, data systems, increased service options, funding/finance, personnel capacity, and training and TA systems.
For Major TA services, the impacts on state and local infrastructure are evaluated through a 6 month follow up survey with participants. Bi-annually, surveys and/or interviews are conducted with key state personnel working with NECTAC on ongoing long-term system change initiatives to determine impacts on systems. In addition to self-report by participants, NECTAC gathers evidence of improvements to systems to substantiate the self-report surveys.
Improved Early Intervention and Preschool Practices is also a longer term outcome of NECTAC TA, supporting service providers and teachers to implement high quality evidenced-based practices. Improve practices may result from the use of what participants learned from TA, or it may be a result of the improved state and local infrastructure. Examples of improved practices include timely identification and referral of all children potentially eligible, completion of functional assessments, timely and meaningful development of IFSPs/IEPs, timely implementation of effective services in natural environments and inclusive settings, and smooth transitions for children and families from early intervention to preschool services.
For Major TA services, the early intervention and preschool practices are evaluated through a 6 month follow up survey with participants. Bi-annually, surveys and/or interviews are conducted with key state personnel working with NECTAC on ongoing long-term system change initiatives to determine impacts on services. In addition to self-report by participants, NECTAC gathers evidence of improvements to services to substantiate the self-report surveys.
Improved results for young children with disabilities and their families is the ultimate outcome. NECTAC contributes to this outcome by supporting State administrators and others to improve systems and services. Data to support this ultimate outcome is sometimes reported through the bi-annual surveys and/or interviews conducted with key state personnel working with NECTAC on ongoing long-term system change initiatives. Whenever possible, NECTAC seeks to gather evidence of improvements to substantiate the self-report surveys.
It is still too early in the Cooperative Agreement to evaluate improved results for children and families related to the improved practices. Evaluation in the upcoming years will include data on this level of improvements. We do have examples from NECTAC’s previous contract of improvements for children and families.