Optional Common Work Plans and Instruments for Senior Companion Projects
In 2006, Senior Corps formed a working group to develop a set of optional work plans and instruments measuring outcomes related to independent living for seniors and support for caregivers. This working group was comprised of a Field Office Director and several Senior Companion project directors. Below are links to the three performance measurement work plans and instruments developed by this working group with assistance from Project STAR. Included in the documents are instructions for administering the instruments and summarizing the data.
In Home Care Service Activity (DOC)
Companionship / Outreach Service Activity (DOC)
Respite Care Service Activity (DOC)
Project STAR pilot tested all three of the instruments and made adjustments, where necessary, to improve the level of content validity (i.e., the measurement tool measures what it purports to measure and not something else). To determine whether the instruments were collecting valid data, qualitative data were collected through interviews with respondents, site supervisors, caseworkers, and program directors.
Of the three instruments, the Respite Caregiver Survey was the only one tested for reliability (i.e., the measurement tool should produce the same results after repeated trials, if nothing has changed). The Respite Caregiver Survey was tested with a very small sample (n=6), using a test-retest method (two administrations), and results showed an acceptable level of reliability. The correlation coefficient for this survey is of .81. A coefficient of .70 or higher is generally considered acceptable.
NOTE: If these instruments are altered, or completed by someone other than the recommended data source, assumptions about validity/reliability may no longer hold true.
Project STAR would like to thank the SCP projects that agreed to pilot these instruments: SCP of San Jose, California; SCP of the City of Oakland, California; and SCP of Waterbury, Connecticut. Because of their hard work, we were able to collect valuable information to improve the data collection tools.
Click here for more information on the pilot tests: Update on SCP Pilot Test (PDF)*
These work plans and instruments illustrate one approach to standardizing performance measurement indicators across multiple projects. Developing standardized work plans and instruments requires balancing the desire of project directors for work plans that express the unique characteristics of their individual projects (e.g., ways of delivering services, conditions under which data are collected, etc.) with the desire to standardize work plans and instruments across multiple projects. It is also important to maintain high standards for measuring performance by using instruments that collect valid and reliable data.
Project STAR is available to assist Senior Corps programs to develop work plans and instruments that balance stakeholder needs while maintaining high standards for measuring performance.
*To view and print PDF files, you need Adobe Reader installed on your computer. If you need to install Adobe Reader, visit the Adobe website.